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This  report  details  the  results  of  mini  study  1.  This  mini  study  was  conducted  at 
the  Federal  Aviation  Administration  (FAA)  Technical  Center  utilizing  the  Data  Link 
test  bed.  Initial  Data  Link  air  traffic  control  services  were  evaluated  under  part 
task  simulation  conditions  in  order  to  identify  service  delivery  methods  which 
optimize  controller  acceptance,  performance,  and  workload.  Tins  report  delineates 
the  results  for  the  first  of  two  mini  studies  and  a  research  and  development 
operational  evaluation  which  comprise  the  Phase  I  Data  Link  services  package .  /v«.  ■ 
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FREFACE 


This  two-volume  report  documents  the  first  Federal  Aviation  Administration 
controller  evaluation  of  a  group  of  three  en  route  air  traffic  control  services 
planned  for  implementation  on  the  Mode  S  Data  Link  system.  Volume  I  contains 
the  main  body  of  the  report.  Volume  II  contains  seven  appendixes  which  support 
the  Test  Description  and  Test  Results  (sections  2  and  3,  respectively)  portions 
of  the  main  body  of  the  report. 
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EXECUTIVE  SQMMtt 


wasassssM. 

The  Federal  Aviation  Administration  (EAA)  Test  Plan  for  the  Mode  S  Data  Link 
defines  a  two-stage  process  far  controller  evaluation  of  candidate  air  traffic 
control  (Me)  services.  In  the  first  stage,  "mini"  design  studies  will  be 
conducted  under  controlled,  part-task  simulation  conditions  to  identify  service 
delivery  Methods  which  optimize  controller  acceptance,  performance,  and 
workload.  In  the  second  stage,  full-scale  simulation  studies  will  be  performed 
in  order  to  verify  the  safety  and  efficiency  of  Data  Link  within  the  context  of 
realistic  operational  scenarios.  This  report  presents  the  results  of  the  first 
FAA  controller  mini  study  of  en  route  XFC  services  developed  far  implementation 
on  the  Data  Link  system. 
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The  specific  objectives  of  this  mini  study  were:  (1)  to  evaluate  and  refine  Data 
Link  controller  procedures  and.  displays  for  the  Altitude  Confirmation,  Transfer 
of  OcBuunioaticn,  and  En  route  Minimum  Safe  Altitude  warning  (EH3AW)  services, 
and  (2)  to  solicit  initial  opinions  from  controllers  regarding  the  general 
utility  of  the  Node  S  Data  Link. 

DMA  UNK  ararencN. 

Data  link  functions  were  integrated  with  the  Host  Oonputer  System  (HCS) 
operational  software  and  the  Qmputer  Display  Channel  (CDC)  displays. 
Capabilities  inducted  radar  data  processing,  tracking,  and  flight  data  inputs. 
Operational  Data  Link  functions  and  procedures  were  integrated  with  current 
operational  procedures  and  oonputer  functions.  Data  base  updates  followed 
altitude  clearances;  handoffs  between  sectors  included  radio  frequency 
aasignaents;  EK5AW  alerts  were  generated  tpon  HCS  notification;  and  altimeter 
settings  were  automatically  tplinked. 

Two  modes  of  operation  were  evaluated,  manual  and  automatic.  In  automatic  mode, 
a  Data  link  massage  was  initiated  and  delivered  via  standard  National  Airspace 
System  (MS)  entries.  The  message  was  displayed  to  the  controller  as  "sent" 
(transmitted  to  aircraft  transponder) ,  "delivered"  (received  by  the  aircraft 
transponder) ,  and  "wiloo"  (pilot  affirmative  reply).  In  manual  mode,  the  status 
indication  "held"  was  displayed  beside  the  massage  that  appeared  in  the  preview 
arse:  Plan  View  Display  (TOD)  or  Outputs*  Readout  Device  (CRD) .  Another 

— qusnoe  of  entries  resulted  in  the  massage  triggering  the  "sent,"  "delivered," 
and  "wiloo^  meatus  indicators  as  appropriate,  m  both  cases  the  NAS  oonputers 
wmn  vpdatad  only  upon  receipt  of  the  wiloo  reply  from  the  pilot.  Pilot  "unable" 
and  no  reply  ("timeout")  conditions  were  also  tested. 


Iseml  air  traffic 
in  *  ssrism  of  Me 
me*  lit*  test  ; 
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participated  in  the  study  as 
anted  at  work  statione  at 
to  permit  the  evaluation 
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test  somariOB  vers  liiited.  lhan  wore  few  trades  and  no  interfacility 
activity.  Traffic  flows  were  repititious  in  nature  and  control  tasks  ware 
restricted.  No  overall  system  delays  were  simulated.  Figure  ES-l  projects  the 
^eip me*tfA  votjcload  for  a  Data  Link  enviroremnt  in  aasparlson  to  present  ABC  field 
conditions. 

Initially,  the  aoemrioB  required  the  controllers  to  acmplete  several  altitude 
MriqsM^OBBfinstieB,  transfer  of  n— ilrsHnsr,  and  BEAN  tasks,  varying  the 
displays  ard  procedures  used  to  aooceplieh  the  three  services.  Both  central 
(IVD)  and  peripteral  (CSD)  locations  wees  tested  fear  the  Data  Link  transaction 
statm  display.  Various  MSP  procedures  were  also  evaluated  which  differed  in  the 
of  controller  actione  required  to  deliver  the  services,  the  requirements 
for  voice  interaction  between  the  controller  and  the  pilot,  and  the  requirement 
for  downlinked  pilot  ccnfizsation  of  service  message  delivery. 

Following  each  test  condition,  the  subjects  rated  the  workload  that  would  be 
induced  by  the  tested  options  under  operational  conditions.  The  technique, 
called  projected  subjective  workload  assessment  technique  (HWSWKT),  asked  the 
controller  to  project  the  effect  of  each  test  condition  on  the  difficulty  of 
their  job  during  a  moderately  busy  workday.  A  score  of  o  (low  workload  effort) 
to  100  (very  high  workload  effort)  was  derived  through  a  conjoint  analysis  of 
tftOSHNr  ratings.  This  technique  results  in  interval  data  capable  of  being 
analyzed  by  parametric  means. 

Another  rating  scale  was  used  after  each  condition  to  assess  controller 
preferences  for  each  condition.  In  addition,  these  formal  data  were  supplemented 
by  group  debriefing  interviews,  a  wrap-up  questionnaire,  and  written  narrative 
ooements  following  the  test  sessions. 

HflMRKK  BESWES- 

General  opinions  of  Data  Link  were  strongly  positive.  A  majority  of  the 
controller  subjects  felt  that  Data  Link  would  definitely  reduce  controller 
workload  and  enhance  ABC  system  capacity  and  safety.  Whereas  the  findings  ware 
positive,  it  should  be  noted  that  the  aquixed  data  are  preliminary  and  that  the 
simulation  environment  and  scenarios  were  limited  with  respect  to  ATC  operations 
in  this  mini  study. 


The  results  of  the  study  clearly  show  that  the  subjects  preferred  the 

Data  link  message  preview  arse  in  the  FVD  rather  than  the  CSD  display.  All 
subjects  felt  that  Data  Link  transaction  status  information  should  be  displayed 
in  a  that  does  net  distract  the  controller's  attention  from  primary 

radar  data.  Furthermore,  because  the  list  format  of  this  display  may  become 
dibfioult  to  manitar  when  multiple  aircraft  and  services  are  presented,  the 
sitjjaets  indicated  that  further  iaproveeents  may  be  achieved  with  key  transaction 
dtfbe  indications  in  the  full  data  block  (FDB) .  The  positive  reaponso  to  Data  Link 
FOB  Mfcm»efc-4ge»  suggests  strongly  that  this  function  should  be  included  in 
mtimijnnr  •valuations.  This  capability  was  not  tested,  implemented,  or 
evaluated  la  this  mini  study. 


lower  workload  and  hi£mr  preference 
to  manually  initiate  uplinks  and 
(see  figure  ES-l) .  However, 
to  inhibit  automated  vplinke  per 
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FIGURE  ES-1.  EFFECTS  OF  AUTOMATIC  PROCEDURES  AMD  ELIMINATION  OF  REDUNDANT 
VOICE  ON  CONTROLLER  WORKLOAD  AND  PREFERENCE 


controller  Action  should  be  available.  The  eubjecte  suggested  that  it  should  be 
po— ihle  to  exenciss  such  proactive  control  ewer  uplinks  by  sector,  service  type, 
and  individual  transaction. 

Although  the  continued  availability  of  a  reliable  voice  radio  charnel  was 
considered  essential,  voice  coeronicatiane  between  the  pilot  and  controller  ware 
redundant  with  Data  lime  and  were  not  preferred  because  of  increased  workload 
(see  figure  EB-1) .  m  addition,  aoee  fore  of  confirmatory  pilot  reapenee  was 
oonsidared  sandatory  for  all  services,  and  a  downlink  was  found  to  be  a  valid 
nethod  for  providing  this  reapenee  inter  "no  voice"  conditions. 

As  noted  earlier,  the  Data  link  ocnoatta  presented  in  this  study  received 
favorable  evaluations  tram  the  objects.  However,  concerns  expressed  by  «-««» 
oontrollers  about  the  reliability  of  the  ipla— itatlon  of  EMSAN,  with  which  they 
were  faadliar,  and  about  the  possible  effects  of  delays  in  operational  Data  link 
transaction  tines  suggest  that  these  issues  will  require  further  attention  in 
future  evaluation  research. 

Oontrollers  judged  that  utilizing  an  optima  Data  Link  configuration  for  the 
three  evaluated  services  would  have  no  negative  effects  on  mhsidiaxy  tasks. 
Such  tasks  as  R-D  controller  coordination,  sector  Interphone,  system  errors, 
weather,  strip  handling,  status  board  information,  and  keeping  the  picture  were 
rated  as  not  being  negatively  Ipnctsd  and,  in  most  oases,  favorably  impacted  by 
Data  Link  capability. 


BmmDMlCHS. 


Raooaasndations  based  on  the  results  outlined  above  include  a  set  of  preliminary 
pacifications  for  the  three  tested  services.  These  findings  may  change  whan 
arihauaal  scenarios  are  evaluated.  The  data  identifies  the  displays  and 
procedures  which  will  be  used  in  a  full  scale,  operational  evaluation  study  of 
the  services  to  be  conducted  at  the  ERA  Technical  Center.  Briefly,  it  is 
raooaaaHted  that  Data  Link  transaction  information  be  located  on  the  PVD, 
preferably  with  a  full  data  block  indication  of  the  Data  link  massage  status. 
Autoaatic  uplinks  and  automatic  massage  diplay  delation  with  pilot  affirmation 
are  also  suggested  with  the  option  to  inhibit  uplinks  using  staple  prefix  code 
keyboard  entries.  After  an  initial  familiarization  period,  redundant  voice 
rrssmkat  buns  ahould  net  be  used  with  Data  link  services.  However,  a  reliable 
voice  eternal  is  mandatory  for  resolving  misunderstandings  and  as  a  backup  for 
syetmi  failures. 

Becmuss  of  the  accelerated  status  of  the  Data  link  program  and  the  definitive 
neu&ts  obtained  from  this  stuty,  it  is  also  vsnraesnteft  that  a  naans  be  devised 
for  providing  regular  and  continued  involvement  of  current  air  traffic 
controllers  in  future  Data  Zink  ATC  service  dasign  and  evaluation  efforts. 
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APPENDIX  A 


TEST  SCRIPTS 


SCRIPT  -  OCNIROIIER  SECTOR  17  -  PHOT  SECTOR  5 
System  Ocranents  and/or 


Time  Position 

Input 

CUtEUt _ 

1245 

cion 

System  Startup 

1246 

SUA 

Sectorizaticn 

Live  sectors  1,2,12,19 

1247 

SUA 

MR  messages 

Map  requests  all  sectors 

1251 

SUA 

AS  messages 

1251 

SUA 

CP  DINK  CN 

Data  Link  on 

For  Test  1  (w/o  D/L) 

1252 

SUA 

CP  DINK  OFF 

No  Data  Link  for  this  test 

Far  Test  2.1  PVD  List, 

Manual, 

Voice 

1252 

03R,  17R,  07R,  1QR 

DS  D  3 

PVD  List 

1252 

03R,  17R,  07R,  1QR 

DS  0  0 

Ifenual  Mode 

For  Test  2.2  CRD  List, 

Manual, 

Voice 

1252 

03R,  17R,  07R,  10R 

DS  D  2 

CRD  List 

1252 

03R,  17R,  07R,  1QR 

DS  0  0 

Manual  Mode 

Par  VAX  File  #17: 

Contains  DYSIM  flight  and  following  settings: 

WILOO  response  will  cause  WIICO  to  be  displayed  in  list  and  clear  in  display 
list  after  60  seconds. 

UNABLE  and  TJMBOOT  will  not  clear  display  list  entries,  will  require  manual 
entry  at  PVD. 

No  TihtmJT  after  delivered  message. 

Far  VAX  File  #18: 

Contains  DYSIM  flight  and  following  settings: 

WILOO  and  TIMEOUT  responses  will  not  change  display  list  and  list  entry  will 
be  cleared  after  60  seconds. 

UNABLE  response  will  display  UNABLE  and  no  clear  for  entry. 

No  TIMEOUT  after  delivered  message. 


A-l 


System 

.liffig 


SCRIPT  -  OQNIFDIXER  SECTOR  17  -  PILOT  SECTOR  5 


Position 


aput 


Ccranents  and/or 


1251>  Pilot  5R 


DifSIM  tracks  (XXXW12) 
start  from  SIM  tape  in 
controller  sector  17  and 
pilot  sector  5. 


1256  Oont-17R 


Say  "Piedmont  33  climb 
and  maintain  flight 
level  200." 


Pilot-5R  PVD  SIM  QAK,  Say  "Piedmont  33 

Altitude  Button  climbing  to  200." 
200  XXXPI33 


Oont-17R 


Asgn  Alt  QAK 
200  XXXPI33 


[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 


Pilot-5R  VAX 


1257  Oont-17R 


Pilot-5R 


(PI33  #)  W  Pilot  WILOOs  D/L 

message. 

Say  "Piedmont  33  climb 
and  maintain  flight 
level  300." 

Say  "Piedmont  33 
UNABLE." 


Oont-17R 


Asgn  Alt  QAK  Assigned  altitude 

300  XXXPI33  altered. 


[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 

Pilot-5R  VAX  (PI33  #)  U  Pilot  enters  "UNABLE." 

[Controller  enters  DL  (QAK  6)  D  XXXPI33  or  CID  to  clear  D/L  entry.  ] 


1258  Oont-17R  XXXAA24  Accepts  handoff  from 

sector  3. 

[For  Manual  Mode  Test,  Controller  must  alter  DL  S  AID  to  said  message.  ] 

Pilot-5  After  seeing  AA24  added  to 

right  side  of  pilot  terminal 
display  and  0-17  in  fdb,  say 
"UDS  Center,  American  24  is 
with  you  at  17  thousand." 


A-2 


System 

Time 

Position 

Incut 

Ccnments  and/or 

Outcut 

Oont-17R 

Say  "American  24,  Roger." 

1259 

Oont-17R 

Say  "Piedmont  33  climb  and 

Pilot-5R  PVD 

SIM  QAK, 

Altitude  Button 

300  XXXPI33 

Say  "Piedmont  33 
climbing  to  300." 

Cont-17R 

Asgn  Alt  QAK, 

Assigned  altitude  entered. 

[For  Manual  Mode  Test,  Controller  most  enter  DL  S  AID  to  send  message.  ] 

Pilot-5R  VAX 

(PI33  #)  W 

Pilot  enters  WILDO  on  pilot 
terminal. 

1300 

Oont-17R 

Say  "Piedmont  33  descend  and 
maintain  flic^it  level  200." 

Pilot-5R  PVD 

SIM  QAK, 

Altitude  Button 

200  XXXPT33 

Say  "Piedmont  33 
descending  to  200." 

r  - 

Oont-17R 

.^1  m  m  »  -  «-  -  - 

Asgn  Alt  QAK, 

200  XXXPI33 

1  1  _ _  _ _ L.  — _ _ _  TNT  /I  1  TTN  i 

Assigned  altitude 
entered. 

[rur  ranucu  nrae  iesu,  ujitroiier  must  enter  uij  o  /vlu  to  senu  massage*  j 

Pilot-5R  VAX 

(PI33  #)  T 

Pilot  enters  TIMEOUT  on 
pilot  terminal. 

[Controller  enters  DL  (QAK  6) 

D  XXXPI33  or  CCD  to  clear  D/L  entry.  ] 

1301 

Ocnt-17R 

03  XXXAA24 

Handoff  initiated  to  sector 
3.  After  Sector  3  accepts 
(0-3  blinking  in  FDB) ,  say 
"American  24,  contact  center 
on  133.0." 

Pilot-SR  VAX 

(AA24  #)  W 

H  XXXAA24  133.000 

Say  "American  24 
changing  to  133.0,  Good 

Day."  Pilot  enters  WHCO  and 
transfer  oarmarri  at  pilot 
terminal. 


A-3 


System 

Time 

1302 


Position 
Oont— 17R 

Pilot-5R  PVD 

Ccnt-17R 


Input 


SIM  QAK, 
Altitude  Button 
100  XXXPI33 

Asgn  Alt  QAK 
100  XXXPI33 


Comments  and/or 
cxitaxrt 

Say  "Piedmont  33,  descend 
and  maintain  10  thousand 
feet. " 

Say  "Piedmont  33 
descending  to  10 
thousand." 

Assigned  altitude  entered. 


[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 

Pilot-5R  VAX  (PI33  #)  W  Pilot  enters  WIICO. 

1303  Oont-17R  Say  "Piedmont  33,  descend  and  maintain  5  thousand." 

Pilot-5R  PVD  SIM  QAK,  Say  "Piedmont  33 

050  XXXPI33 

Oont-17R 


Asgn  Alt  QAK 
050  XXXFI33 


Assigned  altitude  entered. 
[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 


1304 


Pilot-5R  VAX 
Cont-17R 


(PI33  #)  W 


Pilot  enters  Wilco. 

MSAW  flashing  for  XXXIW12. 
Say  "TOA12,  low  altitude 
alert,  climb  to  15  thousand 
feet  immediately." 


[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 


Pilot-5R  PVD 


Pilot-5R  VAX 


SIM  QAK 

Altitude  Button 
150  XXXIW12 


Say  "TWA12  climbing 
to  15  thousand." 


(TW12  #)  W 

Ocnt-17R  XXXAA24 

[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 


1305 


Replies  WILCO  to  EM  message 
on  pilot  terminal. 

Accepts  handoff  for  sector 
3. 


A-4 


System 

Time 


Position 

Pilot-5R 


Incut 


Ocnments  and/or 
Output 


Ccnt-17R 


After  seeing  AA24  added  to 
right  side  of  pilot 
-t-g-rmi  nal  and  0-17  in  FOB, 
say  "UDS  Center,  American  24 
with  you  at  17  thousand." 

Say  "American  24.  Roger." 


A- 5 


SCRIPT  -  CONTROLLER  SECTOR  3  -  PHOT  SECTOR  4 


System 

Time 

Position 

Incut 

Ooranents  and/or 

Outout 

1255 

Pilot-4R 

D¥SIM  tracks  (XXN23C, 
XXXNW32,  XXXAA24)  started 
from  SIM  tape. 

1256 

Oont-3R 

Say  "23  Charlie 

cl  into  and  maintain  15 

thousand." 

Pilot-4R  FVD 

SIM  QAK, 

Altitude  Button 
XXXN23C 

Say  "23  Charlie 
climbing  to  15  thousand. 

Oont-3R 

Asgn  Alt  QAK, 

150  XXXN23C 

Assigned  altitude 
entered. 

[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 

Pilot— 4R  VAX 

(N23C  #)  W 

WILOO  reply  from  pilot. 

1257 

Oont-3R 

Say  "23  Charlie,  climb 
and  maintain  flight 
level  200." 

Pilot-4R  FVD 

SIM  QAK, 

Altitude  Button 
200  XXXN23C 

Say  "23  Charlie 
climbing  to  200." 

Oont-3R 

Asgn  Alt  QAK, 

200  XXXN23C 

Assigned  altitude  entered. 

[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 

Pilot-4R  VAX 

(N23C  #)  W 

Pilot  enters  WILOO  at  pilot 
terminal. 

1258 

Ocnt-3R 

17  XXXAA24 

Handof f  initiated  to  Sector 

17.  After  controller  at 
sector  17  accepts  (0-17 
flashing  in  FDB) ,  say 
"American  24,  contact  UDS 
Center  on  133.2." 

Pilot-4R  VAX  (AA24  #)  W  Say  "American  24 

H  XXXAA24  133.200  changing  to  133.2,  Good 

Day."  Pilot  enters  WILOD  and 
enters  transfer  at  pilot 
terminal. 

1259  Cont-3R  Say  "23  Charlie, 

descend  and  maintain  10 
thousand." 


A-6 


Oorrt-3R 


Asgn  Alt  QAK, 
100  XXXN23C 


Assigned  altitude  entered. 


StS°  Position  unit  <XltnJt 

CR»r  Manual  Mode  Test,  ortroller  »t  enter  DL  S  HD  to  send  nessase.] 


Caments  and/or 


Pilot-4R  VAX 


(N23C  #)  T 


Pilot  alters  TTMECOT  at 
pilot  terminal. 


[Controller  enters  DL  (QAK  6)  D  XXXPI33  or  CTO  to  clear  D/L  entry.] 


Ccnt-3R 


Pilot- 4R  JVD 


Oont-3R 


SIM  QAK, 
Altitude  Button 
200  XXXN23C 

Asgn  Alt  QAK 
200  XXXN23C 


Say  ”23  Charlie,  climb  and 
maintain  flight  level  200.” 

Say  "23  Charlie 
climbing  to  200.” 

Assigned  altitude  entered. 


[ftar  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.] 


pilot-4R  VAX 
Pilot-4R  PVD 


(N23C  #)  W 

SIM  QAK, 
Altitude  Button 
004  XXXNW32 

SIM  QAK, 


Pilot  enters  WHOO. 

Descend  NW32  to  force 
EMSAW 


dimb/Desoent  Button 
99  XXXNW32 


Set  p«y4wiim  descent 
rate. 


Oont-3R 


Pilot-4R  PVD 


Pilot-4R  VAX 


Cont-3R 


SIM  QAK 

Altitude  Button 
090  XXXNW32 

(NW32  #)  W 


17  XXXAA24 


MSAW  flashing  for  XXXNW32. 
Say  "Northwest  32,  low 
altitude  alert,  climb  to  9 
thousand  immediately." 

Say  "Northwest  32 
climbing  to  9  thousand." 


Replies  Wiloo  to  EM 


Pilot-4R  VAX 


Handof  f  initiated  to  sector 
17.  After  sector  17 
accepts,  say  "American  24, 
contact  UDS  Center  on 
133.2." 


(AA24  #)  W  Say  "American  24  _ 

H  XXXAA24  133.200  changing  to  133.2,  Good 

Day." 


SCRIPT  -  OCNIRDIIER  SECTOR  07  -  PHOT  SECTOR  14 


System 

Time  Position 


£jgut 


Comments  and/or 
Output 


1255  Pilot- 14R 


OTSIM  tracks  (XXXNW02, 
XXXPA22,  XXXUAL1)  started 
from  SIM  tape. 


Pilot-14R  PVD  SIM  QAK,  Descend  PA22  to  force 

Altitude  Button  EMS MM. 

004  XXXPA22 


SIM  QAK,  Set  Hnwriiwim  descent 

Climb/Descend  But  rate. 

ton 


1256  Cont-07R 

Pilot-14R 


Say  "Northwest  2  descend  and 
maintain  flight  level  200." 

Say  "Northwest  2  descending 
to  fli^it  level  200." 


Oont-07R 


Asgn  Alt  QAK  Assigned 
altitude  entered. 

200  XXXNW02 


[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 


Pilot-14R  VAX 
1257  Cont-07R 

Pilot-14R 

Cont-07R 


(NW02  #)  W 


Asgn  Alt  QAK 
300  XXXNW02 


Pilot  wiloos  D/L  message. 

Say  "Northwest  2  climb  and 
maintain  flight  level  300." 

Say  "Northwest  2  unable  to 
comply." 

Assigned  altitude 
entered. 


[For  Manual  Mode  Test,  Controller  oust  enter  DL  S  AID  to  send  message.  ] 

Pilot-14R  VAX  (NW02  #)  U  Pilot  enters  "UNABLE." 

[Controller  enters  DL  (QAK  6)  D  XXXNW02  or  CID  to  clear  D/L  entry.  ] 

1258  Cont-07R  msaw  flashing  for  XXXPA22. 

Say  "Clipper  22,  low 
altitude  alert,  climb  to  15 
thousand  imnediately . " 


[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 


System 

-Tjjae, 


Position 
Pilot-14R  PVD 


Pilot-14R  VAX 


Oont-07R 


Pilot-14R  VAX 


Cont-07R 


Pilot-14R  PVD 


Ocnt-07R 


Beat 

SIM  QAK 

Altitude  Button 
150  XXXRA22 

(PA22  #)  W 


10  XXXUAL1 


(UAU  #)  W 


SIM  QAK, 
Altitude  Button 
300  XXXNN02 

Asgn  Alt  QAK 
300  XXXNH02 


Garments  and/or 


Say  "Roger.  Clipper 
22  climbing  to  15 
thousand." 

Replies  W3U30  to  EM  message 
on  pilot  terminal. 

Handoff  initiated  to  sector 
10.  After  sector  10  accepts 
(0-10  blinking  in  FDB) ,  say 
"United  1,  contact  center  on 
123.0." 

Sav  "Rocjer. 

United  1  H  XXXUAL1 
123.000  Changing 
to  123.0,  Good 
Day."  Pilot  enters 
WIICD  and  transfer 
on  pilot  terminal. 

Say  "Northwest  2 
climb  and  maintain 
flight  level  300." 

Say  "Northwest  2 
climbing  to  300." 


Assigned  Altitude 
entered. 


[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 


Pilot-14R  VAX 


Oont-07R 


Pilot-14R  PVD 


Oont-07R 


(NW02  #)  W 


Pilot- 14R  VAX 


SIM  QAK, 
Altitude  Button 
200  XXXNW02 

Asgn  Alt  QAK 
200  XXXNW02 

(NW02  #)  T 


Pilot  enters  WIDOO  on  pilot 
terminal. 

Say  "Northwest  2  descend  and 
maintain  flight  level  200." 

Say  "Northwest  2 
descending  to 
200." 

Assigned  altitude, 
entered. 

Pilot  enters  TIMEOUT  on 
pilot  terminal. 


[Controller  enters  DL  (QAK  6)  D  XXXPI33  or  CXD  to  clear  D/L  entry.  ] 


A-10 


System 

Time 


Input 


Cements  and/or 
_ Output 


Position 
1301  Cont-07R 


Accepts  handoff  from  sector 

10. 


[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 

Pilot-14R  VAX  After  seeing  UAL1  dded  to 

right  side  of  pilot  display 
and  0-14  in  FEB,  say  "UDS 
Center,  United  1  is  with  you 
at  flight  level  300." 


Ocnt-07R 

Say  "United  1,  Roger." 

1302 

Oont-07R 

Say  "Northwest  2,  descend 
and  maintain  10  thousand." 

Pilot-14R  PVD 

SIM  QAK, 

Altitude  Button 

100  XXXNW02 

Say  "Northwest  2 
descending  to  10 
thousand." 

C5ont-07R 

Asgn  Alt  QAK 

100  XXXNW02 

Assigned  altitude 
entered. 

1303 

Qxit-07R 

Say  "Northwest  2,  climb  and 
maintain  flight  level  200." 

Pilot-14R  PVD 

SIM  QAK, 

Altitude  Button 

200  XXXNW02 

Say  "Northwest  2 
climbing  to  200." 

Oont-07 

Asgn  Alt  QAK 

200  XXXNW02 

Assigned  altitude 
entered. 

[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 

Pilot-14R  VAX 

(NW02  #)  W 

Pilot  enters  WUOO. 

1305 

Oont-07R 

10  XXXUAIA 

Handoff  initiated 
to  sector  10. 

After  sector  10 
accepts,  say 
"United  1,  contact 

Center  on  123.0." 

Pilot- 14R  VAX 

(UAKL  #)  W 

H  XXXUAL1  123.000 

Say  "United  1 
changing  to  123.0, 

Good  day."  Pilot  enters 
WILOD  and  transfer  ocnmands 
on  pilot  terminal. 


A-ll 


SCRIPT  -  OCNTROIIER  SECTOR  10  -  PHOT  SECTOR  15 
System  Cements  and/or 


Time 

Position 

fisyt 

(Xrtxut 

1255 

Pilot-15R 

DYSIM  tracks  (XXXCS22, 
XXXAL62)  started  from  SIM 
tape. 

Pilot- 15R  PVD 

SIM  QAK, 

Altitude  Button 
004  XXXAL62 

Descend  AL62  to 
force. 

EMSAW 

SIM  QAK,  Set  maximum  descent  rate. 

Climb/Desoent  Button 

99  XXXAL62 

1256 

COnt-lOR 

Say  "Charlie 

Sierra  22,  descend  and 
-"\intain  15 
thousand." 

Pilot-15R  PVD 

SIM  QAK, 

Altitude  Button 
150  XXXCS22 

Say  "Charlie 

Sieza  22 
descending  to  15 
thousand." 

Oont-IOR 

Asgn  Alt  QAK, 

150  XXXCS22 

Assigned  altitude 
entered. 

Pilot-15R  VAX 

(CS22  #)  W 

WILOO  reply  from 
pilot. 

1257 

Oont-IOR 

Say  "Charlie 

Sierra  22,  climb  and 
maintain  flight  level  200. 

Pilcrt-15R  PVD 

SIM  QAK, 

Altitude  Button 
200  XXXCX22 

Say  "Charlie 

Sierra  22  climbing 
to  200." 

Oont-IOR 

Asgn  Alt  QAK, 

200  XXXCS22 

Assigned  altitude 
entered. 

(For  Manual  Made  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 


Pilot-15R  VAX 


(GS22  #)  W 


Pilot  enters  W3ICO 
at  pilot  terminal. 


System 

Tiff? 


Position 

Oorrt-IOR 


Input 


Oonments  and/or 


MSAW  flashing  for  XXXAL62. 
Say  "USAir  62,  low  altitude 
alert,  climb  to  flight  level 
9  thousand  irmediately." 


[For  Manual  Mode  Test,  Controller  mist  enter  DL  S  AID  to  said  message.  ] 


Pilot-15R  FVD 


Pilot- 15R  VAX 


Oorrt-IOR 


SIM  QAK 

Altitude  Button 
090  XXXAL62 

(AL62  #)  W 


XXXUAL1 


Say  •'USAir  62  climbing 
9  thousand" . 


Replies  WILOO  to  EM 
message. 

Accepts  handoff  from 
sector  07. 


[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 


Pilot-l5R 


Ccnt-IOR 


Cont-IOR 


Pilot- 15R 


Cont-IOR 


Asgn  Alt  QAK 


After  seeing  UAL1  added  to 
right  side  of  display  and 
0-10  in  FDB,  say  "UDS 
Center,  United  1  is  with  you 
at  flight  level  300." 

Say  "United  1,  Roger." 

Say  "Charlie  Sierra  22, 
thousand." 

Say  "Charlie  Sierra  22 
UNABLE  to  ocrply." 

Assigned  altitude  entered. 


[Par  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 


Pilot- 15R  VAX 


(CS22  #)  U 


Pilot  enters  UNABLE. 


[Controller  enters  DL  (QAK  6)  D  XXXCS22  or  CID  to  clear  D/L  entry.  ] 


Ccnt-IOR 


Pilot-15R  PVD 


0cnt-3D 


SIM  QAK 

Altitude  Button 
050  XXXGS22 

Asgn  Alt  QAK 
050  XXXN23 


Say  "Charlie  Sierra  22, 
descend  and  maintain  5 
thousand." 

Say  "Roger.  Charlie 
Sierra  22  descending  to 
5  thousand." 

Assigned  Altitude 
entered. 


A-13 


System  Cements  and/or 

Time  Position  Incut  CXitput 

[Par  Manual  Mode  Test,  Controller  mist  enter  DL  S  AID  to  sand  message.  ] 

Pilot-15R  VAX  (CS22  #)  W  Pilot  enters  WIICO  at  pilot 

terminal. 

1301  Ocrrt-IOR  07  XXXUALl  Handoff  initiated  to  sector 

07.  After  controller  at 
sector  07  accepts  (0-07 
flashing  in  Ft©) ,  say 
"United  1,  contact  UDS 
Center  on  132.2." 


Pilot-15R  VAX 

(UAL1  #)  W 

H  XXXUALl  132.200 

Say  "United  1  changing 
to  132.2,  Good  Day." 

1302 

Oont-IOR 

Say  "Charlie  Sierra  22, 
climb  and  maintain  10 
thousand." 

Pilot- 15R  PVD 

SIM  QAK, 

Altitude  Button 

100  XXXGS22 

Say  "Charlie  Sierra 

22  climbing  to  10 
thousand." 

Cont-IOR 

Asgn  Alt  QAK, 

100  XXXCS22 

Assigned  altitude  entered 

[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 

Pilot-15R  VAX 

(CS22  #)  T 

Pilot  enters  TIMEOUT  at 
pilot  terminal. 

(Controller  enters  DL  (QAK  6) 

D  XXXPI33  or  CID  to  clear  D/L  entry. ] 

1303 

Oont-IOR 

Say  "Charlie  Sierra  22, 
climb  and  maintain  flight 
level  200." 

Pilot-15R  PVD 

SIM  QAK, 

Altitude  Button 

200  XXXCS22 

Say  "Charlie 

Sierra  22  climbing  to 
200." 

Oont-IOR 

Asgn  Alt  QAK 

200  XXXCS22 

Assigned  altitude 
entered. 

[For 

Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 

Pilot- 15R  VAX 

(CS22  #)  W 

Pilot  enters  WILCO. 

1305 

Oont-IOR 

XXXUALl 

Accepts  handoff  front 
sector  7. 

A-14 


System 

Time 


Position 


Input 


Cements  and/or 
_ Output 


[For  Manual  Mode  Test,  Controller  must  enter  DL  S  AID  to  send  message.  ] 

Pilot-15R  After  seeing  UAU  added  to 

right  side  of  display  and 
0-15  in  FDB,  say  "UDS 
Center,  United  1  is  with  you 
at  flight  level  300." 

Ccnt-IOR  Say  "United  1.  Roger." 


A-15 


B 

RATING  MATERIALS 


BRIEF  DESCRIPTION  OF  THE  FRQSWAT 
WORKLOAD  SCALE  DEVELOPMENT  PROCESS 


The  Subjective  Workload  Assessment  Technique  (SWAT)  was  developed  in  the  early 
1980's  by  researchers  at  the  Air  Force  Aerospace  Medical  Research  Laboratory. 
Using  SWAT,  human  operators  make  judgements  about  the  workload  that  they 
experienced  during  actual  performance  of  an  operational  task.  Projected 
Subjective  Workload  Assessment  Technique  (PROSWAT)  is  an  application  SWAT  in 
which  operators  make  projective  estimates  of  the  workload  that  would  be  produ-jed 
by  a  set  of  test  conditions  or  system  design  options.  These  projected  estimates 
are  based  on  observations  of  low  fidelity  simulations  of  a  system  rather  than 
actual  performance  of  the  operational  task.  FRQSWAT  has  been  proven  useful  for 
workload  evaluation  of  design  options  prior  to  the  availability  of  full  scale 
simulators  or  operational  hardware. 

SWAT  and  PROSWAT  operate  in  the  same  way,  and  require  a  two-phase  process  to 
generate  quantitative  workload  data.  In  the  first  phase,  subjects  provide 
information  on  how  time,  effort,  and  stress  combine  to  produce  their  concept  of 
mental  workload. 

During  this  scale  development  exercise,  the  subjects  are  asked  to  sort  a  set  of 
27  cards  on  which  are  printed  all  possible  combinations  of  the  descriptors  for 
the  time,  effort,  and  stress  scales.  Subjects  sort  the  cards  to  produce  an 
ordering  that  represents  situations  ranging  from  low  to  high  workload.  The 
subjects'  sorts  are  then  subjected  to  a  computerized  conjoint  analysis  in  order 
to  determine  the  ocmninatory  rule  governing  the  sort.  An  iterative  routine  is 
then  used  to  generate  an  interval  scale  value  for  each  of  the  27  combinations 
that  fits  the  ocmninatory  rule  and  preserves  the  original  ordering.  The  result 
of  this  processing  is  a  look-up  table  for  each  subject  or  subject  group  that 
converts  the  discrete  time,  effort,  and  stress  workload  ratings  to  the  unitary 
scale. 

In  the  second  phase,  subjects  make  actual  workload  judgements  of  test  conditions 
using  ratings  of  1  (low)  to  3  (high)  on  the  time,  effort,  and  stress  scales. 
These  ratings  are  then  interpreted  as  quantitative  values  on  the  overall  workload 
scale  found  in  the  look-up  table. 

The  advantage  of  the  FRQSWAT  approach  to  workload  assessment  is  that  it  adjusts 
the  scale  to  each  subject's  or  group's  conception  of  workload.  In  addition,  the 
scale  provides  more  powerful  interval  scale  values  rather  than  the  ordinal 
values  typical  of  most  subjective  rating  techniques.  The  instructions  used  in 
this  study  far  guiding  the  subject  controllers'  card  sorting  task  are  presented 
in  the  following  section  of  this  appendix  alcng  with  the  instructions  used  for 
the  preferenoe/aooeptability  scale. 


B-1 


(INSTRUCTIONS  TO  CONTROLLER  SUBJECTS) 


INTRODUCITCN  TO  THE  OCWTROLLER  WORKLOAD 
AND  OPTION  PREFERENCE  RATING  SCALE 


B&CKGRCUND 

The  goal  of  this  study  is  to  obtain  expert  opinions  from  air  traffic  controllers 
about  the  most  appropriate  ways  in  which  to  inplement  three  air  traffic  oontroll 
(ATC)  services  using  the  Mode  S  Data  Link.  When  we  start  our  stimulations  in  the 
Data  Link  Test  Bed  you  will  be  controlling  air  traffic  in  a  series  of  brief 
scenarios.  Each  test  run  will  require  you  to  use  different  displays  or 
procedures  to  aoccnplish  the  Data  Link  services.  In  order  to  evaluate  these 
service  design  options,  we  will  ask  you  to  provide  two  quantitative  ratings  after 
each  test  run.  The  purpose  of  this  document  is  to  familiarize  you  with  the 
scales  that  you  will  be  using  to  make  the  ratings,  and  to  describe  a  special 
procedure  that  we  will  ask  you  to  perform  to  help  us  interpret  your  ratings  on 
one  of  the  scales.  The  material  contained  in  this  document  will  be  reviewed  in  a 
briefing  that  you  will  receive  before  we  start  the  Data  Link  Test  Bed  simulation 
runs. 


Although  we  will  be  asking  you  for  a  wide  variety  of  cements  during  this  study, 
our  primary  quantitative  data  will  be  derived  from  your  ratings  on  the  two  scales 
mentioned  above.  Because  the  rating  data  will  form  the  basis  for  a  number  of 
Data  Link  design  decisions,  it  is  extremely  important  that  we  all  agree  on  what 
we  mean  by  each  type  of  rating  scale. 

The  first  scale  that  you  will  ccnplete  after  each  test  run  is  the 
HEFERENCiyACXEPEABIIJTY  scale.  The  form  that  will  be  used  for  this  scale  is 
shown  in  figure  B-l. 

One  of  the  forms  will  be  used  for  each  procedure  and  display  option  that  you 
evaluate.  Note  that  the  form  actually  requires  you  to  make  two  decisions. 
First,  for  each  of  the  services,  you  will  need  to  decide  whether  the  option 
under  test  is  acceptable  or  unacceptable.  Second,  if  you  have  decided  that  the 
option  is  acceptable,  you  will  need  to  assign  it  a  value  on  the  7 -point  scale 
that  indicates  the  extent  to  which  you  prefer  it.  Thus,  you  would  assign  the 
option  a  value  of  "1"  if  you  found  it  to  be  both  acceptable  and  highly 
preferable.  If  the  option  were  acceptable  but  not  highly  preferred,  you  would 
assign  it  a  higher  number  according  to  the  extent  to  which  it  is  less 
preferable.  However,  if  the  option  were  oonpleteJy  unacceptable,  you  would  not 
assign  it  any  of  the  numbers,  and  instead  mark  the  OCMFLEIELY  UNACCEPTABLE  blank 
on  the  form. 

In  making  your  decisions  about  acceptability  and  preference,  your  prime 
consideration  should  be  the  impact  of  a  design  optical  on  the  SAFETY  and 
EFFICIENCY  of  controller  performance.  Once  you  have  made  your  ratings,  please 
remember  to  use  the  cements  section  on  the  bottom  on  the  form  to  briefly 
explain  the  reasons  for  your  ratings. 


B-2 


SUBJECT  - 
SECTOR  _ 

TEST  OPTION 


SERIES  I  /  II 
ACTIVE  /  PASSIVE 


Rale  the  display  /  procedural  test  option  that  you  have 
just  examined  according  to  how  acceptable  it  would  be  to 
controllers  involved  in  each  ot  the  three  services.  In 
rating  the  acceptability  of  this  option,  you  should  consider 
the  way  In  which  it  would  affect  the  SAFETY  and  EFFICIENCY 
of  the  controller's  performance, 

Place  an  'X'  next  to  the  number  which  best  describes 
the  acceptability  of  this  option  tor  each  service.  If 
this  option  is  completely  unacceptable,  place  an  ’X"  In 
the  box.  Use  the  space  below  the  scales  to  briefly 
explain  your  ratings. 


HIGHLY 

MODERATELY 

ACCEPTABLE 

PREFERRED 

PREFERRED 

BUT  NOT 

1 

1 

PREFFERED 

1 

▼ 

1  2 

▼ 

3  4  5 

f 

0  7 

ALT 

CONF 


TRAN 

COMM 


EM  SAW 

- L-jJ 

COMPLETELY 

UNACCEPTABLE 


COMMENTS: 


FIGURE  B-I.  PREFERENCE/ACCEPTABILITY  SCALE 
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WSW6D 


The  second  rating  that  we  will  be  asking  for  sifter  each  test  run  will  be  a 
workload  rating.  The  scale  that  we  will  be  using  for  the  workload  ratings  is 
known  sis  Projective  Subjective  Workload  Assessment  Technique  (HROSWAT) .  EBOSWAT 
was  developed  as  a  method  for  collecting  quantified  data  on  how  hard  a  person 
feels  he  would  have  to  work  in  his  normal  duties  using  different  procedures, 
equipment,  etc. ,  to  perform  them.  In  this  study  we  will  be  asking  you  to  provide 
PRDSWRT  ratings  cn  the  workload  that  you  would  experience  during  a  moderately 
busy  shift  of  work  if  you  were  using  each  of  the  Data  Link  options  that  we  will 
be  testing. 

If  you  examine  the  scale  in  figure  B-2  you  will  notice  that  PROSWAT  defines 
workload  in  terms  of  a  combination  of  three  different  dimensions  that  contribute 
to  the  subjective  feeling  of  "working  hard."  A  workload  rating  in  H&SWAT  is 
acocuplished  by  selecting  a  1,  2,  or  3  on  EACH  of  the  three  scales  representing 
the  dimensions  of  TIME  IDAD,  MENIAL  EFFORT,  and  PSYCHOLOGICAL  STRESS  LOAD. 

Each  of  these  dimensions  and  their  levels  are  described  below: 


TIME  LOAD. 


Time  Load  refers  to  the  fraction  of  the  total  time  that  you  are  busy.  When  Time 
Load  is  lew,  sufficient  time  is  available  to  complete  all  of  your  mental  work 
with  seme  time  to  spare.  As  Time  Load  increases,  spare  time  drops  out  and  some 
aspects  of  performance  overlap  and  interrupt  one  another.  This  overlap  and 
interruption  can  come  from  performing  more  than  one  task  or  from  different 
aspects  of  performing  the  same  task.  At  high  levels  of  Time  Load,  several 
aspects  of  performance  often  occur  simultaneously ,  you  are  busy,  and 
interruptions  are  very  frequent. 

Time  Load  may  be  rated  on  the  3-point  scale  below: 

1.  Often  have  spare  time.  Interruptions  or  overlap  among  activities  occur 
infrequently  or  not  at  all. 

2.  Occasionally  have  spare  time.  Interruptions  or  overlap  among  activities 
occur  frequently. 

3.  Almost  never  have  spare  time.  Interruptions  or  overlap  among  activities  are 
very  frequent,  or  occur  all  the  time. 


As  described  above,  Time  Load  refers  to  the  amount  of  time  one  has  available  to 
perform  a  task  or  tasks.  In  contrast,  Mental  Effort  Load  is  an  index  of  the 
amount  of  attention  or  mental  effort  required  by  a  task  regardless  of  the  number 
of  tasks  to  be  performed  or  any  time  limitations.  When  Mental  Effort  Load  is 
low,  the  concentration  and  attention  required  by  a  task  is  minimal  and 
performance  is  nearly  automatic.  As  the  demand  for  mental  effort  increases  due 
to  task  ccnplexity  of  the  amount  of  information  which  must  be  dealt  with  in 
order  to  perform  adequately,  the  degree  of  concentration  and  attention  required 
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OFTEN  SPARE  TIME.  INTERRUPTIONS,  OR  OVERLAP  AMONG  ACTIVITIES  OCCUR  INFREQUENTLY  OR 
NOT  AL  ALL. 
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increases.  High  Mental  Effort  Load  demands  total  attention  or  concentration  due 
to  task  complexity  or  the  amount  of  information  that  must  be  processed. 

Mental  Effort  Load  may  be  rated  using  the  3-point  scale  below: 

1.  Very  little  conscious  mental  effort  or  concentration  required.  Activity  is 
almost  automatic,  requiring  little  or  no  attention. 

2.  Moderate  conscious  mental  effort  or  concentration  required.  Oonplexity  or 
activity  is  moderately  high  due  to  uncertainty,  unpredictability,  or 
unfamiliarity.  Considerable  attention  required. 

3.  Extensive  mental  effort  and  concentration  are  necessary.  Very  complex 
activity  requiring  total  attention. 

PSYCHOLOGICAL  STRESS  LDAP. 

Psychological  Stress  Load  refers  to  the  contribution  to  total  workload  of  any 
conditions  that  produce  anxiety,  frustration,  or  confusion  while  performing  a 
task  or  tasks.  At  lew  levels  of  stress,  one  feels  relatively  relaxed.  As 
stress  increases,  confusion,  anxiety,  or  frustration  increase  and  greater 
concentration  and  determination  are  required  to  maintain  control  of  the 
situation. 

Psychological  Stress  Load  may  be  rated  on  the  3-point  scale  below: 

1.  Little  confusion,  risk,  frustration,  or  anxiety  exists  and  can  be  easily 
aooomnodated. 

2.  Moderate  stress  due  to  confusion,  frustration,  or  anxiety  noticeably  adds  to 
workload.  Significant  compensation  is  required  to  maintain  adequate 
performance. 

3.  High  to  very  intense  stress  due  to  confusion,  frustration,  or  anxiety.  High 
to  extreme  determination  and  self-control  required. 

Each  of  the  three  dimensions  just  described  contribute  to  workload  during 
performance  of  a  task  or  grot?)  of  tasks.  Note  that  although  all  three  factors 
may  be  correlated,  they  need  not  be.  For  example,  one  can  have  many  tasks  to 
perform  in  the  time  available  (hi#i  time  load) ,  but  the  tasks  may  require  little 
concentration  (lew  Mental  Effort  Load) .  Likewise,  one  can  be  anxious  and 
frustrated  (high  Stress  Load)  and  have  plenty  of  spare  time  between  relatively 
sinple  tasks.  Since  the  three  dimensions  contributing  to  workload  are  not 
necessarily  correlated,  please  treat  each  dimension  individually  and  give 
independent  assessments  of  the  Time  Load,  Mental  Effort  Load,  and  Psychological 
Stress  Load  that  you  feel  would  be  produced  by  the  Data  Link  design  options  we 
will  be  testing. 

The  form  that  you  will  be  using  to  make  your  SWAT  ratings  during  the  Data  Link 
test  sessions  is  shewn  in  figure  B-3.  Note  that  the  descriptions  for  each  level 
of  time,  effort,  and  stress  load  have  been  removed  to  save  space.  Should  you 
need  to  review  these  descriptions  during  testing,  a  copy  of  the  full  scale  will 
be  available  at  all  times. 
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SUBJECT  — 

SECTOR  _ 

TEST  OPTION 


SERIES  I  /  II 
ACTIVE  /  PASSIVE 


Rate  the  workload  associated  with  the  display/procedure 
option  that  you  have  just  examined  by  considering  how  It 
would  affect  the  difficulty  of  your  Job  during  a  moderately 
busy  workday.  With  this  in  mind,  rate  the  workload 
associated  with  each  service  under  this  option  by  placing 
an  ’X’  next  to  one  of  the  numbers  on  the  TIME,  EFFORT  AND 
STRESS  soa lee. 

REMEMBER,  this  Is  a  rating  of  the  WORKLOAD  that  you 
would  experience  using  this  option.  The  workload  of  a  task 
Is  not  neoeaaarlly  related  to  your  preferences  for  a  test 
option  or  I ta  suitability  for  use  in  ATC  operations. 


ALTITUDE  CONFIRMATION  1  2  3 

TIME  LOAD  -  - 

MENTAL  EFFORT  _  _ 

STRESS 

TRANSFER  OF  COMMUNICATIONS 

TIME  LOAD  _  _ 

MENTAL  EFFORT 
STRESS 


EM  SNA 

TIME  LOAD 
MENTAL  EFFORT 
8TRE88 


FIGURE  B-3.  PROSWAT  WORKLOAD  SCALE 
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FROSWAT  SCALE  DEVEIOFMENT  CARD  SORT 


New  that  you  are  familiar  with  the  two  rating  scales  that  will  be  used  during 
the  Data  link  test  sessions,  there  is  one  last  procedure  that  most  be  completed 
before  testing  can  begin.  This  procedure  is  a  card  sorting  task  that  will  allow 
us  to  interpret  your  FROSWAT  workload  ratings.  We  will  be  asking  you  to  do  this 
task  during  the  briefing  that  will  take  place  to  review  the  rating  scales. 

One  of  the  most  important  features  of  FROSWAT  is  its  unique  scoring  system.  The 
developers  of  FROSWAT  recognized  that  different  people  have  different 
conceptions  of  how  the  time,  effort,  and  stress  dimensions  combine  to  produce  an 
overall  impression  of  low  and  high  workload.  Because  of  these  differences,  a 
special  card  sorting  procedure  is  used  in  FROSWAT  to  define  a  distinctive 
workload  scale  for  each  person.  This  individualized  scale  greatly  improves  our 
ability  to  accurately  interpret  the  actual  workload  ratings  that  you  will  be 
making  during  the  test  sessions. 

In  order  to  develop  your  individual  scale,  we  need  information  from  you 
regarding  the  amount  of  workload  that  you  feel  is  produced  by  various 
combinations  of  the  three  levels  on  the  time,  effort,  and  stress  dimensions.  We 
get  this  information  by  having  a  person  rank  order  a  set  of  cards.  Each  card 
contains  a  different  combination  of  the  levels  of  time  load,  mental  effort  load, 
and  stress  load.  Since  there  are  three  dimensions,  and  each  dimension  has  three 
levels,  there  are  27  cards  in  the  deck  that  you  will  be  sorting.  Your  job  will 
be  to  sort  the  cards  so  that  they  are  ranked  according  to  the  level  of  workload 
represented  by  each  card.  Thus,  the  first  card  in  the  deck  will  represent  the 
lowest  workload  and  the  last  card  will  represent  the  highest  workload. 

In  completing  your  card  sorts,  please  consider  the  workload  imposed  on  a  person 
by  the  combination  represented  in  each  card.  Arrange  the  cards  from  the  lowest 
workload  condition  through  the  highest  condition.  You  may  use  any  strategy  you 
choose  in  rank  ordering  the  cards.  One  strategy  that  proves  useful  is  to 
arrange  the  cards  into  a  number  of  preliminary  stacks  representing  high, 
moderate,  and  low  workload.  Individual  cards  can  be  exchanged  between  stacks, 
if  necessary,  and  then  rank  ordered  within  stacks.  Stacks  can  then  be 
recombined  and  checked  to  be  sure  that  they  represent  your  ranking  of  lowest  to 
highest  workload.  However,  the  choice  of  strategy  is  up  to  you  and  you  should 
choose  the  one  that  works  best  for  you. 

There  is  no  "school  solution"  to  this  problem.  There  is  no  correct  order.  The 
correct  order  to  what,  in  your  judgement  best  describes  the  progression  of 
workload  from  lowest  to  highest  for  a  general  case  rather  than  any  specific 
event.  That  judgement  differs  for  each  of  us.  The  letters  you  see  on  the  back 
of  the  cards  are  to  allow  us  to  arrange  the  cards  in  a  previously  randomized 
sequence  so  that  everyone  gets  the  same  order.  If  you  examine  your  deck  you 
will  see  the  order  on  the  back  runs  from  A  through  Z  and  then  ZZ. 

Please  remember: 

1.  The  card  sort  is  being  done  so  that  a  workload  scale  may  be  developed  for 
you.  This  scale  will  have  a  distinct  workload  value  for  each  possible 
combination  of  Time  Load,  Mental  Effort  Load,  and  Psychological  Stress  Had. 
The  following  example  demonstrates  the  relationship  between  the  card  sort  and 
the  resulting  workload  scale: 
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Time 


Effort 


Stress 


Workload  Scale 


11  1  0.0 


•  •  •  • 
33  3  100.0 

Note  that  other  them  the  fact  that  a  1-1-1  will  always  represent  the  lowest 
workload  and  that  a  3-3-3  will  always  represent  the  highest  workload,  the 
remaining  cards  could  occur  in  a  number  of  orders.  Your  order  will  depend  on 
how  you  weight  the  importance  of  Time,  Effort,  and  Stress  dimensions. 

2.  When  performing  the  card  sorts,  use  the  descriptors  printed  on  the  cards. 
Please  remember  not  to  sort  the  cards  based  on  one  particular  task  (such  as 
controlling  air  traffic) .  Sort  the  cards  according  to  your  general  view  of 
workload  and  how  important  you  consider  the  dimensions  of  Time,  Mental  Effort, 
and  Psychological  Stress  Load  to  be. 

3.  During  the  Data  Link  test  runs,  you  will  aoocnpli&h  the  desired  task.  Thai, 
you  will  provide  a  FTOSWAT  rating  based  an  your  opinion  of  the  mental  workload 
required  to  perform  the  task.  This  FR0SWAT  rating  will  consist  of  one  number 
from  each  of  the  three  dimensions.  For  example,  a  possible  FPQSWAT  rating  is  1- 
2-2.  This  represents  a  1  far  Time  Load,  a  2  far  Mental  Effort  Load,  and  a  2  for 
Psychological  Stress  Load. 

4.  We  are  not  asking  for  your  preference  concerning  Time,  Mental  Effort,  and 
Psychological  Stress  Load.  Some  people  may  prefer  to  be  "busy"  rather  than 
"idle"  in  either  Time  Load,  Mental  Effort  Load,  or  Psychological  Stress  Load 
dimension.  We  are  not  concerned  with  this  preference.  We  need  information  on 
hew  the  three  dimensions  and  the  three  levels  of  each  one  will  affect  the  level 
of  workload  as  you  see  it.  You  may  prefer  a  2-2-2  situation  instead  of  a  1-1-1 
situation.  However,  ycu  should  still  realize  that  the  1-1-1  situation  imposes 
less  workload  an  you  and  leaves  a  greater  reserve  capacity. 

The  sorting  will  probably  take  30  minutes  to  an  hour.  Please  feel  free  to  ask 
questions  at  any  time. 
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A  FINAL  NOTE  ABOUT  YOUR  PREFERENCE  AND  FRQSWAT  RATINGS 


Die  two  scales  that  we  will  be  using  in  our  Data  Link  test  sessions  were  chosen 
to  quantify  two  independent  aspects  of  your  evaluations  of  the  Data  Link  display 
and  procedural  test  options.  As  you  use  the  scales  to  rate  the  test  options, 
please  remember  that  preferenoe/aoceptability  and  workload  nay  be  related,  but 
they  are  not  necessarily  the  same. 

Far  example,  you  nay  find  that  a  particular  option  is  not  preferred  because  it 
would  greatly  increase  controller  workload.  In  that  case,  both  your 
preferencse/acoeptabil ity  and  IROSWAT  ratings  would  be  high.  However,  it  is  also 
possible  far  these  two  ratings  to  be  disassociated.  For  example,  an  option  might 
be  acceptable  or  unacceptable  because  of  its  impact  on  AFC  safety.  At  the  same 
time,  the  workload  that  would  be  associated  with  delivering  a  Data  Link  service 
using  that  option  could  be  lew  or  high,  depending  on  how  you  feel  it  would  affect 
the  time,  effort,  and  stress  load  associated  with  performing  controller  tasks. 

In  order  for  us  to  extract  the  maximum  amount  of  information  from  this  study,  it 
is  very  important  that  you  keep  these  differences  in  mind  as  you  make  your 
ratings.  As  experts,  your  careful  oensideration  of  each  of  the  scales  will  help 
to  insure  that  Data  Link  is  implemented  in  a  way  which  will  enhance  ATC  safety 
and  efficiency  and  aid  the  controller  in  meeting  his  or  her  responsibilities . 
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INTRODUCTION 


This  appendix  presents  an  analysis  of  data  from  the  debriefing  discussion.  In 
the  context  of  the  ministudy  methodology,  the  debriefing  followed  laboratory 
exercises  that  allowed  the  test  participants  to  interact  with  simulated  Data 
Link  services  presented  under  alternative  combinations  of  message 
display/ccntrol  and  procedural  options.  In  all,  ten  Air  Traffic  Control 
Specialists  (ATCS1  s)  participated  in  the  debriefing  discussion.  Following  the 
group  discussion,  nine  of  the  ten  participants  ail  so  submitted  written  responses 
to  the  items  covered  in  the  debriefing  discussion  guide. 

The  appendix  is  organized  into  two  parts.  The  first  part  of  the  appendix 
describes  the  participants  and  their  expertise  and  reviews  the  areas  of  agreement 
and  unresolved  issues  that  came  out  of  the  debriefing.  The  second  part  provides 
a  copy  of  the  discussion  guide  and  tabulates  the  categorical  responses  that  were 
reported  individually  by  the  ATCS's. 


SUJMNRy  OF  RESULTS 


This  suttmary  flight  takes  up  the  generic  thanes  and  then  the  specific  service- 
related  suggestions  contained  in  the  ATCS  commentary.  In  the  following  section, 
"Test  Participants,"  descriptive  characteristics  of  the  test  participants  are 
reported.  Presented  in  section  cure  generic  thanes  or  principles  of  Data  Link 
cxmmunication  that  cut  across  individual  services.  The  principles  help  explain 
many  of  the  specific  service-related  suggestions  discussed  in  section,  "Initial 
Data  Link  Services. " 


TEST  PARTICIPANTS. 

Ten  ATCS's  were  involved  in  the  tests:  eight  served  as  test  subjects  at  the 
control  positions  and  two  others  were  roving  observers  who  spent  same  time 
observing  each  of  the  positions.  All  eight  test  participants  represented  the 
Dallas/Forth  Worth  Center.  The  two  roving  observers  represented  the  Dallas/Fort 
Worth  Terminal  and  the  Center.  On  average,  the  test  participants  had  15.7  years 
experience  as  full  performance  level  (FPL)  controllers  end  experience  levels 
ranged  between  3  and  31  years.  Four  of  the  participants  also  had  experience  as 
pilots.  Pilot  experience  ranged  between  5  and  20  years  with  an  average  of  16 
years.  Only  three  of  the  participants  reported  any  exposure  to  the  Data  Link 
program  prior  to  this  evaluation. 


RAL  DATA  LINK. 


Establishment  of  a  set  of  basic  operational  and  design  principles  for  Data  Link 
cxxtnunication  is  consistent  with  other,  ongoing  Federal  Aviation  Administration 
(FAA)  initiatives  to  standardize  air  traffic  control  (ATC)  operations  (reference 
1) .  These  principles  are  the  ground  rules  from  which  direchives  for  operational 
practices  and  criteria  for  system  design  and  validation,  can  be  established.  The 
basic  principles  derived  from  the  debriefing  are  discussed  below. 
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A  Message  Not  Acknowledged  Message  Not  Sent. 


This  emerged  as  a  first  principle  of  ATC  camunication  (reference  2,  pg  C-7) . 
Data  Link  ocrmunication  should  also  follow  this  principle  operationally  and  in 
design.  In  particular,  there  is  a  need  to  ensure  that  the  ATC  data  base  contains 
the  last  acknowledged  clearance.  For  a  confirmation  message,  the  current  test 
bed  design  is  acceptable  because  the  voice  exchange  provides  an  acknowledgment 
(authorizes  a  data  base  update)  before  any  Data  Link  message  is  sent.  When  Data 
Link  becomes  the  primary  ocmnunication  mode,  the  ATC  data  base  update  should  be 
triggered  by  the  pilot’s  WILOO,  not  by  the  controller's  EOTEFVTJFLINK  action. 

The  current  design  uses  the  ENTER  action  associated  with  an  altitude  amendment 
to  accomplish  two  things:  it  updates  the  ATC  data  base  and  generates/uplinks  a 
Data  Link  message.  Conceptually,  generation  and  uplink  of  a  message  to  the  pilot 
should  be  separable  from  a  data  base  update.  Operationally,  the  update  should  be 
effected  by  the  pilot's  acknowledgment.  Similarly,  the  controllers  cxxrmented 
that  it  was  not  important  or  necessary  to  update  their  status  displays  to  show 
intermediate  stages  in  the  information  exchange.  For  instance,  a  message  status 
update  for  a  technical  acknowledgment  was  considered  unnecessary,  only  the  pilot 
WILOO  was  meaningful  (operationally) .  Exceptions/ interruptions  to  the  normal 
sequence  should  be  treated  as  "alerts"  and  displayed  more  prominantly,  i.e. ,  in 
the  data  block. 

A  positive  pilot  acknowledgment  of  a  Data  Link  message  was  judged  to  be  the  best 
procedure  from  an  operational  transition  standpoint.  Although  controller 
opinion  was  split  on  the  need  for  a  transitional  phase  of  redundant 
radio/telephone  (r/t)  oxmmmication  with  Data  Link  (d/1)  confirmation,  there  was 
consensus  that  even  in  the  transitional  phase,  a  positive  acknowledgment  of  the 
confirmation  message  would  be  more  compatible  with  the  procedure  followed  in  a 
later  phase  when  the  voice  exchange  drops  cut. 

Use  r/t  Qamnunication  for  Resolution  of  Exceptions  to  Normal  d/1  Communication 
and  for  Time  Critiical  Ocmnunicaticns. 

With  two  modes  available  for  ccrrnunicaticn  between  pilots  and  controllers,  it  is 
important  to  specify  hew  these  will  work  together  in  the  future  system. 
Moreover,  a  mix  of  d/1  equipage  in  the  aircraft  population  will  require  continued 
use  of  r/t  oorrrunication  procedures  as  the  primary  mode  for  some  aircraft.  To 
make  things  easier,  the  procedures  for  d/1  and  r/t  cxmnunicaticn  should  be 
consistent  and  explicit  criteria  should  be  established  for  determining  the 
appropriate  node  in  a  given  situation  (see  reference  3) .  Both  the  pilot  and 
controller  should  have  a  common  understanding  and  expectation  about  what  the 
other  will  do  under  various  sets  of  circumstances. 

The  advantage  of  voice  communication  for  handling  exceptions  and  time  critical 
control  instructions  was  mentioned  many  times  during  the  discussion.  The  two 
most  cxnmonly  agreed  on  roles  of  voice  and  data  link  cxmrunicaticn  were:  (1) 
Data  Link  as  the  primary  mode  for  most  messages,  with  voice  as  a  backup  for 
handling  exceptions,  and  (2)  Data  Link  as  the  primary  mode  for  certain  types  of 
messages,  with  voice  as  the  primary  mode  for  other  types  of  messages.  Aside  from 
handling  exceptions  to  control  instructions,  in-flight  emergencies  and  weather 
deviations  were  also  identified  as  situations  where  voice  should  be  the  primary 
node.  In  addition,  there  was  unanimous  agreement  that  voice  should  be  the 
primary  node  for  all  types  of  time  critical  messages. 
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Controller  opinion  on  the  acceptability  of  a  mixed-mode  oocnunication  system  was 
divided.  While  most  agreed  that  Data  Link  would  afford  the  greatest  benefit  to 
controllers  in  their  message  sending  functions  and  pilots  would  see  the  greatest 
benefit  in  their  message  receiving  functions,  only  half  endorsed  a  mixed-mode 
(controller  uplink  with  pilot  voice  acknowledgment)  approach  to  pilot  controller 
ccranunicat  ion . 

Display  d/1  Qonmunication  Stutus  Information  in  the  Data  Block. 

Controllers  expressed  a  clear  preference  for  encoding  Data  Link  message  status 
information  in  the  data  block  with  a  supplementary  list  presentation  on  the  Plan 
View  Display  (PVD) .  For  example,  it  was  suggested  that  the  altitude  line  of  the 
data  block  be  used  to  depict  the  status  of  an  altitude  confirmation.  One  way  to 
implement  this  suggestion  might  be  to  add  a  new  class  of  indicators  to  the 
altitude  qualifier  field  (B4)  that  displays  the  status  of  the  exchange:  "S"  for 
sent,  "W"  wiloo,  "V”  verify. 

As  another  illustration,  the  transfer  of  ccranunicaticn  (TOC)  message  could  be 
displayed  in  the  handoff  field  (E1-E4) .  Once  the  TOC  message  is  sent,  a  letter 
identifier,  "C"  for  comm  or  "F"  for  frequency,  and  the  identifier  of  the  sector 
which  will  be  in  ccmmunicaticn  with  the  aircraft  would  blink  in  field  E  until  the 
pilot  acknowledges  the  TOC.  Pilot  acknowledgment  would  replace  the  "C"  with  a 
"W"  and  stop  the  blinking. 

After  a  parameter  time,  the  data  block  would  then  be  dropped  from  the  losing 
controller's  display  and  field  E  would  revert  to  groundspeed  on  the  receiving 
controller's  display. 

Controller  alerts  in  the  data  block  for  exceptions  to  a  positive  acknowledgment 
were  also  discussed  in  some  detail.  These  included  a  case  where  the  pilot  fails 
to  acknowledge  the  message  within  a  parameter  time,  a  case  where  the  message  is 
not  delivered  (no  technical  acknowledge) ,  and  a  case  where  the  pilot  responds 
with  an  UNABLE.  Regarding  display  information,  the  controllers  recommended 
adopting  status  labels  of  NO  REPLY,  UNABLE,  and  VERIFY  in  the  list  and 
hichlighting  the  corresponding  data  block  indicators  to  alert  the  controller. 
The  controller  could  then  opt  to  resend  the  message  or  follow  up  with  voice.  In 
the  second  case,  the  current  controller  should  first  be  alerted  to  a  link  failure 
and  follow  up  with  voice.  Based  on  the  follow  up,  the  controller  may  update  the 
aircraft's  data  link  equipage  for  display  to  downstream  controllers.  in  the 
third  case,  the  controllers  suggested  that  if  the  pilot  cannot  ocnply  with  the 
clearance  then  the  UNABLE  response  should  be  correlated  procedural  ly  with  a 
radio  call.  Voice  is  probably  the  sinplest  way  to  resolve  this  kind  of 
situation.  If  the  UNABLE  has  to  do  with  a  possible  miscommunicat ion ,  the 
controllers  recommend  that  the  status  display  should  say  something  like  VERIFY. 
The  controller  then  has  the  option  to  resend  the  Data  Link  message  or  follow  up 
with  voice. 

Finally,  it  was  suggested  that  Data  Link  equipage  be  encoded  near  the  data  block, 
possibly  as  an  alternate  aircraft  position  symbol,  and/or  in  the  data  block  as  a 
caret  symbol  over  the  aircraft  call  sign. 
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Most  of  the  controllers  felt  that  the  inputs  required  to  uplink  a  massage 
manually  in  the  test  scenarios  ware  too  cumbersome.  Accordingly,  they 
recommended  that  the  sequence  of  inputs  required  to  send  a  message  be  simplified 
and  possibly  be  implied  in  the  message  oanposition  sequence.  Transferring  data 
entries  directly  from  the  existing  message  composition  preview  display  (without 
reentry  of  any  fields)  for  automatic  uplink  was  deemed  most  efficient. 
Capabilities  to  store  and  recall/resend  messages  were  also  suggested. 

Overall,  an  automatic  uplink  was  viewed  as  the  most  appropriate  default  option 
for  message  sending  with  an  inhibit  option  to  deselect  Data  Link  by  position, 
service,  or  message.  If  Data  Link  is  selected  for  a  position,  then  automatic 
uplink  is  assumed  for  all  services.  In  the  automatic  mode,  ocnposition  and  entry 
of  an  altitude  assignment  would  automatically  uplink  the  associated  altitude 
confirmation.  Acceptance  of  a  handoff  offer  would  automatically  uplink  a  TOC 
message;  generation  of  an  en  route  minimum  safe  altitude  warning  (EMSAW)  alert 
would  automatically  uplink  that  alert. 

Data  link  may  also  be  inhibited  by  service  or  message.  Inhibiting  by  service 
inhibits  a  display  of  the  message;  inhibiting  by  message  displays  the  message  but 
inhibits  its  uplink.  In  the  manual  mode,  the  controller  would  be  required  to 
make  an  additional  input  when  ocnposing  the  altitude  assignment  message  to 
inhibit  the  uplink.  For  a  manual  TOC,  the  handoff  offer  should  be  initiated  by 
the  controller  (i.e. ,  automatic  handoff  is  inhibited  for  that  aircraft  or  the 
controller  offers  the  handoff  early)  with  an  extra  input  to  inhibit  the  automatic 
uplink  of  the  TOC.  For  the  EMSAW  alert,  the  controllers  suggested  that  manual 
mode  may  be  the  desired  default.  This  could  be  accomplished  by  inhibiting  the 
Data  Link  EMSAW  service. 

Ultimately,  the  schemes  used  for  today's  automatic  handoff  INHTBTT/raART F.  and 
the  EMSAW  alert  suppression  capabilities  should  be  EMSAW  message  uplink. 

In  view  of  the  range  of  planned  d/1  services,  the  controller  should  have  the 
flexibility  to  configure  the  workstation  to:  (1)  send  a  Data  Link  message  to  the 
pilot  with  no  associated  data  base  update,  (2)  update  the  data  base  without 
sending  a  message  to  the  pilot,  and  (3)  send  a  message  to  the  pilot  that  also 
updates  the  data  base  at  the  conclusion  of  the  exchange. 

Initial  Data  T.ink  Services. 

The  next  three  sections  discuss  the  detailed  cements  on  the  standard  operating 
procedures  for  each  service  and  the  special  situations  that  may  require 
nonstandard  treatment.  Because  much  of  the  content  is  process  oriented,  it 
conveys  a  better  understanding  of  the  dynamics  of  the  controller  interaction  with 
each  service. 


Altitude  Assi 
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^Confirmation. 


The  controllers  reached  agreement  on  candidate  operating  procedures  for  a  simple 
altitude  assignment  confirmation  and  a  Data  Link  (no  voice)  altitude  assignment. 
Tables  C-l  and  C-2  illustrate  the  respective  procedures.  For  the  altitude 
confirmation  message,  the  procedure  begins  with  the  controller  voicing  an 
altitude  assignment  followed  by  a  pilot  readback  of  the  altitude.  The 
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TABLE  0-1.  AIUTTUEE  ASSIGNMENT  OCNFITMATICN  (AUTOMATIC  MODE) 


Event 

Resoonsibilitv 

Action 

1.  Altitude 
Assignment 

1.1 

controller 

1.1.1 

Issues  altitude 
assignment  to  A/C 
(r/t) 

1.2 

Pilot 

1.2.1 

Acknowledges  and  reads- 
back  altitude  assignment 
(r/t) 

1.3 

Controller 

1.3.1 

Enters  altitude  assignment 

2.  Altitude 

Confirmation 

2.1 

ATC  Ocnputer 

2.1.1 

Updates  data  base  with 
new  altitude 

2.1.2 

Generates  altitude 
confirmation  message, 
displays  message  "sent"  to 
controller,  and  sends 
message  to  A/C  (cyi) 

2.2 

VC 

2.2.1 

Receives  altitude 
confirmation  message  and 
displays  to  pilot 

2.3 

Pilot 

2.3.1 

Acknowledges  altitude 
confirmation  message  (d/1) 

2.3.2 

Maneuvers  A/C  in  accordance 
with  controller's  instruc¬ 
tions 

2.4 

ATC  Ocnputer 

2.4.1 

Receives  acknowledgment  and 

deletes  display  of 
cx3tfiEHB.ti.cn  message 


TABLE  02.  AUTTUEE  ASSIGNMENT  (ALfICMAITC  MXE) 


Event 

Responsibility 

Action 

1.  Altitude 

1.1 

Controller 

1.1.1 

Enters  altitude  assignment 

Assignnent 

1.2 

ATC  Computer 

1.2.1 

Generates  altitude 
assignnent  message, 
displays  message" sent"  to 
controller,  and  sends 
message  to  h/C  ((^1) 

1.3 

A/C 

1.3.1 

Receives  altitude 

assignnent  message  and 
displays  to  pilot 

1.4 

Pilot 

1.4.1 

Acknowledges  altitude 
assignnent  message  (d/1) 

1.4.2 

Maneuvers  A/C  in  accordance 
with  controller's  instruc¬ 

tions 

1.5 

ATC  Computer 

1.5.1 

Receives  acknowledgment  and 
deletes  display  of  altitude 
assignment  message 

1.5.2 

Updates  data  base  with  new 
altitude 
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controller  then  inputs  an  altitude  amendment  which,  in  turn,  automatically 
generates  an  entry  in  the  Data  Link  status  display  and  uplinks  a  confirmation 
message  (at  this  point  the  ATC  data  base  and  data  block  displays  for  the  aircraft 
are  updated) .  The  procedure  concludes  with  a  pilot  WILOO  input  that 
automatically  deletes  the  entry  from  the  controller's  list.  As  table  C-2  shows, 
the  Data  Link  altitude  assignment  (no  voice)  procedure  is  nearly  identical 
except  that  the  controller's  amendment  should  not  update  the  ATC  data  base  until 
the  WILOO  is  received. 

The  discussion  of  restricted  and  interim  altitudes  uncovered  some  interesting 
operational  issues  and  concxxnitarrt  design  considerations.  Regarding  restricted 
altitudes,  the  controllers  suggested  the  "altitude/fi^altitude"  format  (see 
reference  4,  pg  4-2) .  This  specifies  an  altitude  to  be  maintained  until  the  fix 
is  reached,  then  a  second  altitude  to  be  maintained.  According  to  the 
controllers,  the  format  is  seldom  used  in  the  field  partly  because  message 
construction  is  complicated.  It  was  suggested  that  this  format  be  used  to 
construct  and  store  a  set  of  canned  instructions  for  restricted  altitudes.  For 
each  position,  these  would  ccnprise  routine  clearances,  including  the  kinds  of 
standard  boundary  and  fix  crossing  restrictions  currently  published  in  each 
Center's  standard  Operating  Procedures. 

Another  issue  came  up  in  the  context  of  interim  altitudes.  In  the  past,  interim 
altitudes  have  been  used  by  controllers  to  accomplish  intersector  coordination 
without  a  voice  cxmmunication  (see  reference  2,  pg  F-7) .  While  adoption  of  the 
National  operational  Position  Standards  should  proscribe  such  controversial 
practices,  similar  procedural  or  design  controls  may  need  to  be  developed  for  use 
of  Data  Link.  As  an  illustration,  should  the  Data  Link  system  apply  a  similar 
sector  eligibility  check  ("/CK")  to  the  uplink  of  all  Data  Link  messages?  Hew 
does  the  system  ensure  that  all  the  affected  sectors  have  current  flight  intent 
data?  Is  use  of  Data  Link  considered  optional?  During  this  discussion,  it  was 
suggested  that  Data  Link  may  discourage  nonstandard  practices  by  remediating 
some  of  the  coordination  and  message,  composition  problems  that  gave  rise  to 
them. 

Transfer  of 

The  controllers  reached  agreement  on  a  candidate  operating  procedure  for  the 
transfer  of  ocnnunicaticn.  Table  0-3  illustrates  the  basic  procedure,  handoff 
with  an  associated  TOC;  and  table  C-4  illustrates  a  carmen  variant,  the  handoff 
with  no  TOC.  Taking  account  of  current  and  future  practice,  the  controllers 
reconmended  that  operationally  the  TOC  should  be  separable  from  but  related  to 
the  transfer  of  control  task  as  follows: 

1.  Upon  acceptance  of  a  handoff,  a  TOC  message  for  that  aircraft  is 
automatically  generated  and  displayed  to  the  losing  sector.  The  sector  that 
asamma  (xoputer  control  is  assumed  to  be  the  one  that  will  also  ocranunicate  with 
the  aircraft  on  the  voice  frequency  appearing  in  the  TOC  message. 

2.  Depending  on  how  the  workstation  is  configured,  the  TOC  message  may  be 
uplinked  automatically.  The  uplink  will  then  generate  a  notification  on  the 
receiving  controller's  Data  Link  list.  If  the  automatic  uplink  is  inhibited,  the 
losing  controller  may  issue  an  alternative  TOC  message  by  voice. 
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TABUS  C-3.  HANDOFF  WITH  TRANSFER  OF  OCMCNICATION  (ALfTCKATIC  MODE) 


Event 

Respcnsibilitv 

Action 

1.  Sector  Handoff 

1.1 

Transferring 

Sector 

Controller 

i.i.i 

As  aircraft  approaches 
sector  boundary,  offers 
handoff  to  receiving  con¬ 
troller 

1.2 

ATC  Ocnputer 

1.2.1 

Displays  handoff  offer 
to  receiving  controller 

1.3 

Receiving 

Sector 

1.3.1 

Accepts  handoff 

Controller 

2.  Transfer  of 

Ocnnunlcation  (TOC) 

2.1 

ATC  Ocnputer 

2.1.1 

Displays  TOC  message 
"sent"  to  transferring  and 
receiving  controllers  and 
sends  frequency  to  A/C 

(<VD 

2.2 

A/C 

2.2.1 

Receives  TOC  messages 
and  displays  to  pilot 

2.3 

Pilot 

2.3.1 

Acknowledges  TOC  message 

«VD 

2.4 

ATC  Ocnputer 

2.4.1 

Deletes  display  of  "sent" 
to  transferring  controller 

2.4.2 

Displays  status  of  "call" 
to  receiving  controller 

2.5 

Pilot 

2.5.1 

Check-ins  with  receiving 
controller 

2.6 

Receiving 

Controller 

2.6.1 

Deletes  TOC  display 
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TABLE  0-4.  HANDOFF  WITH  NO  TRANSFER  OF  CCMCNICATION  (MANUAL  MDOE) 


Event 

Responsibility 

Action 

1.  Sector  Handoff 

1.1 

Transferring 

Sector 

l.l.l 

As  aircraft  approaches 
sector  boundary,  offers 
handoff  to  receiving 
controller  with  extra  input 
to  inhibit  automatic 
uplink 

1.2 

ATO  Computer 

1.2.1 

Displays  handoff  offer 
to  receiving  controller  and 
displays  TOC  message  "held" 
transferring  and  receiving 
controllers 

1.3 

Receiving 

Sector 

Controller 

1.3.1 

Accepts  handoff 

2.  Transfer  of 
Ocnmnicatlon 
(TOC) 

2.1 

Transferring 

Sector 

Controller 

2.1.1 

Issues  new  frequency 
to  pilot  (r/t)  or 

«V1) 

2.1.2 

If  d/1  TOC  message  is  sent, 
both  sector  displays  are 
updated  and  deleted  as  in 
table  0-3 

2.2 

Pilot 

2.2.1 

Acknowledges  and 
readsback  new  frequency 
(r/t)  or  (d/1) 

2.3.2 

Changes  frequency 

2.5 

Pilot 

2.5.1 

Checks- in  with  receiving 
controller  (r/t) 

2.6 

Receiving 

Controller 

2.6.1 

Deletes  display  of 
"call"  or  "held"  from 

TOC  list  display 
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3.  Upon  pilot  acknowledgment  of  the  TOC  message,  the  losing  sector's  display 
will  be  cleared  and  the  receiving  sector's  display  will  be  updated  to  a  status  of 
CMIi. 

No  agreement  was  reached  on  a  procedural  requirement  for  a  radio  chedc-in  on  the 
frequency.  Same  felt  it  wasn't  inportant;  others  weren't  so  sure.  Nor  was  there 
consensus  on  a  process  for  clearing  the  CALL  message  from  the  receiving 
controller's  display.  The  message  could  be  deleted  manually,  but  cued  by  the 
radio  check-in  or  it  could  time  out. 

Die  handoff  with  no  transfer  of  ocnmunicatians  is  typically  followed  to  avoid 
issuing  a  series  of  radio  frequency  changes  to  the  flight  crew  (see  reference  2) . 
Far  instance,  this  occurs  with  departing  aircraft  dishing  through  several  low, 
medium,  and  high  altitude  sectors  to  a  cruise  altitude  or  with  aircraft  whose 
horizontal  routes  cut  the  comers  of  several  sectors.  In  the  case  of  a  point 
out,  neither  ocqputer  control  nor  radio  ocimuunication  is  transferred.  While  the 
candidate  procedures  described  in  the  tables  will  permit  handoff  with  no  TOC  by 
allowing  the  losing  controller  to  inhibit  an  automatic  TOC  message,  they  are  also 
intended  to  keep  oonputer  control  and  ocununicaticn  assigned  to  same  controller 
by  making  this  the  easiest  way  to  issue  the  TOC. 


EMSAW. 


Indeed,  this  was  a  controversial  service.  Host  of  the  ccnmentary  concerned  the 
false  alert  problem.  Generally,  it  was  felt  that  operating  procedures  for  this 
service  probably  needed  to  be  determined  locally  and  input  from  ATCS's  who  work 
in  Centers  with  more  mountainous  terrain  was  needed.  Beyond  that,  there  was  a 
more  fundamental  question  of  whether  Data  Link  would  be  faster  than  voice. 
However,  on  the  assumption  that  Data  Link  is  a  viable  way  to  deliver  an  EMSAW 
alert,  it  was  reoomnended  that  the  message  content  match  the  phraseology  defined 
in  the  Controller's  Handbook  (reference  5  pg  2-2) :  "Low  Altitude  Alert.  Check 
your  altitude  imaadiately.  The  wrinimm  en  route  altitude  in  your  area  is  — . " 
Table  05  illustrates  the  candidate  operating  procedure  devised  for  a  Data  Link 
EMSAW  service. 

As  an  alternative  to  an  EMSAW  service,  it  was  suggested  that  an  altitude  out  of 
ocnfannance  service  could  be  developed  to  work  in  conjunction  with  the  «+/-" 
qualifier  that  already  appears  in  the  data  block. 
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TABLE  0-5.  EMSAW  ALERT  (MANUAL  MDDE) 


Event 

Resocnsibilitv 

Action 

1.  EMSAW  Alert 

1.1 

Controller 

1.1.1 

Selects  Data  Link  inhibit 
for  EMSAW  alert 

1.1 

ATC  Ccnputer 

1.1.1 

Displays  Data  Link 

EMSAW  inhibit  in  Data  Link 
service  select  header 

1.1.2 

Projects  that  A/C  will 
violate  minimum  safe 
altitude 

1.1.3 

Displays  EMSAW  alert  to 
controller 

1.2 

Controller 

1.2.1 

Observes  alert,  examines 
flight  intent,  and  deter¬ 
mines  validity 

1.2.2 

Deselects  data  link  EMSAW 
inhibit 

1.3 

ATC  Ccnputer 

1.3.1 

Removes  EMSAW  inhibit 
indicator  in  service  select 
header 

1.3.2 

Displays  EMSAW  message 
"sent"  to  controller 

1.4 

Pilot 

1.4.1 

Acknowledges  EMSAW 
message  (4/1) 

1.4.2 

Maneuvers  A/C  in  accordance 
with  controller's  instruc¬ 
tion 

1.5 

ATC  Ocnputer 

1.5.1 

Deletes  EMSAW  display 

C-11 


C-12 


Test  Controller  Information 
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Prior  to  this  test,  were  you  familiar  with  the  data  link  program? 
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EMSAW  (low  altitude)  alert? 
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Except  In  manual  mode  using  a  CRD  list  containing  several  pending  D/L  messages. 
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Initially,  use  radio  communications  to  issue  an  ATC  Instruction 
and  also  use  data  link  for  confirmation  of  the  instruction 

(for  a  test  period,  then  phase  out  voice) 

Initially,  use  data  link  by  itself  to  issue  the  Instruction 
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Data  link  as  primary  g 
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D/L  may  have  negative  impact  on  workload 
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Only  for  verification  -  Either  D/L  or  voice,  not  both 
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WRAP-UP  QUESTIONNAIRE 


1.  How  would  you  rate  the  simulation  realism.  (Circle  One) 
(Please  disregard  small  amount  of  traffic.) 

Very  Slightly  Slightly  Very 

Good  Good  Good  Fair  Poor  Poor  Poor 

(VG)  (G)  (SG)  (F)  (SP)  (P)  (VP) 

2.  How  can  we  enhance  realism?  (Use  extra  space  on  back.) 


3.  Please  document  any  system  malfunctions  that  if  worked 
as  designed  would  have  helped  you  make  a  better  evaluation. 


4.  Looking  back  at  training,  any  new  ideas  as  to  what 
training  would  have  aided  testing? 


5.  Please  rate  the  SWAT  data  collection  technique  as  it 
applies  to  ATC  mental  workload  analysis. 

SWAT  ASPECTS  VG  G  SG  F  SP  P  VP 


a.  How  well  does  sort  separate  work  loads? 


b.  How  independent  are  the  loads?  Can  one 
load  remain  at  1  while  the  others  go  to  3? 


c.  How  well  does  SWAT  measure  ATC  workload? 


Comments  on  SWAT. 


% 
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6.  Please  rate  these  data  link  aspects  regarding  possibility  of 
utilization  in  the  field. 

ASPECTS  VG  G  SG  F  SP  P  VP 


Automatic  Node 


Hanual  Node 
Using  RCRD  for  display 
Using  PVD  for  display 
Her, sage  response  times 


Comments? 


7 .  Please  select  the  optimum  methods  for  the  three  services . 

(Circle  choices.) 


Control  Pilot 

Mode  Voice  Voice  Display 


Alt  Confirm 

Hanual 

Auto 

Yes 

No 

Yes 

No 

PVD 

CRD 

Trans  Comm. 

Hanual 

Auto 

Yes 

No 

Yes 

No 

PVD 

CRD 

EHSAW 

Hanual 

Auto 

Yes 

No 

Yes 

No 

PVD 

CRD 

Comments? 


8.  Please  rate  how  well  each  service  would  perform  at  your 
position  if  optimally  configured. 

SERVICE  VG  G  SG  F  SP  P  VP 


Altitude  Confirmation 


Transfer  of  Communication 


EHSAW 


Comments? 
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9.  Using  the  optimum  services,  what  would  be  the  projected 
effect  of  data  link  at  your  position  on  the  following: 

PROJECTED  EFFECT  ON  VG  G  SG  F  SP  P  VP 

System  capacity  (a/c  in  sector)  ~ 

_______________ 

Weather  handling  -  "  ~~ 

R-D  controller  coordination 

Sector  Interphone  coordination  ~ '  ~~  ~  ~~ 

Pilot-controller  communications  " 

A/C  conflicts  (system  errors)  ~ 

Flight  strip  marking/handling  " 

Status  board  info,  handling 

Overall  efficiency  (speed)  ~  ~  ~ 

Overall  safety  ~  ~ 

overall  controller  workload 

Comments? _ 


10.  Using  data  link  should  leave  no  "gaps"  in  the  system.  Did 
you  see  any  places  where  gaps  in  positive  control  could  occur? 
Also,  give  any  ideas  as  how  to  prevent  them. 


11.  What  about  data  link  do  you  like  best,  and  why? 


i 


12.  What  about  data  link  do  you  like  least,  and  why? 


13.  What  future  services  would  you  like  to  see  data  link  do? 
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The  primary  measures  used  during  formal  data  collection  in  the  Data  Link  test  bed 
were  controller  ratings  of  the  workload  associated  with  each  test  option  and  of 
their  preference  for  each  option.  Following  every  test  condition,  the  controller 
subjects  ocnpleted  two  rating  forms.  The  first  form  required  the  subject  to 
project  the  workload  that  would  be  associated  with  the  option  on  a  moderately 
busy  work  day  for  each  of  the  three  services.  The  method  that  was  used  to  obtain 
these  ratings  is  known  as  the  Projective  Subjective  Workload  Assessment  Technique 
(PROSWAT) .  EROSWAT  ratings  were  assigned  by  judging  the  test  options  on  three, 
3-point  scales  referring  to  time  load,  mental  effort  load,  and  psychological 
stress. 

The  second  form  required  the  subject  to  judge  the  test  option  as  acceptable  or 
unacceptable  in  terms  of  its  effect  on  air  traffic  control  (ATC)  safety  and 
efficiency.  If  judged  acceptable,  the  subject  rated  the  option  on  a  7-point 
rating  scale  ranging  from  "highly  preferred"  to  "acceptable,  but  not  preferred." 
Comments  were  solicited  at  the  bottom  of  the  form  in  order  to  determine  the 
subject's  rationale  for  his  preference  ratings.  Saitples  of  each  of  the  rating 
forms  as  well  as  instructions  for  their  use  are  contained  in  appendix  B. 

PROSWAT  DATA 


CARD  SORT  ANALYSES. 

The  quantitative  interpretation  of  ERDSWAT  ratings  is  based  on  an  analysis  of  a 
preliminary  card  sorting  task  which  is  used  to  determine  the  way  in  which 
subjects  combine  the  three  dimensions  of  the  scale  to  produce  an  overall  concept 
of  workload.  In  the  current  study,  this  task  was  completed  by  all  eight  test 
controllers  prior  to  training  and  testing  in  the  Data  Link  test  bed. 

Computer  analysis  of  the  card  sorts  revealed  only  moderate  agreement  among  card 
orderings  (W=.74) .  In  EROSWAT,  such  a  result  makes  it  undesirable  to  use  single 
scale  solution  for  all  subjects  in  a  sanple.  As  a  consequence,  the  SWAT 
prototyping  algorithms  were  employed  to  identify  subgroups  of  subjects  who 
produced  similar  card  sorts.  This  algorithm  classified  three  subject  sorts  in 
the  time  prototype,  two  in  the  effort  prototype  and  three  in  the  stress 
prototype.  Classification  within  a  prototype  group  indicates  that  the  subject 
weighed  the  associated  factor  more  strongly  than  the  others  when  performing  the 
sort. 

Analysis  of  the  agreement  among  subjects  within  the  prototype  subgroups  shewed 
that  all  three  were  acceptable  (time,  r=.9Q;  effort,  r=.89;  stress,  r=.90). 
Therefore,  separate  scaling  solutions  were  computed  for  the  three  prototype 
groups  using  the  SWAT  conjoint  measurement  and  scaling  programs.  The  resulting 
tables  relating  time,  effort,  and  stress  ratings  to  interval  scale  values  were 
used  to  score  the  EROSWAT  ratings  of  individual  subjects  classified  in  those 
groups.  Table  E-l  presents  the  card  orderings  for  each  subject  along  with  the 
mapping  of  scale  values  assigned  to  the  prototype  groups. 

The  statistical  analyses  which  follow  were  performed  on  EROSWAT  scores 
transformed  from  the  ordinal  ratings  using  the  prototype  scaling  solution 
identified  for  each  subject.  In  each  case,  one  to  three  ratings  on  the  three 
dimensions  were  interpreted  by  referring  to  the  appropriate  subgroup  scale  which 
ranged  from  0  (lew  workload)  to  100  (high  workload) . 
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TABLE  E-l.  FRDSWAT  CARD  SORTS  AND  PROTOTYPE  SCALE  VALUES 


Subject  Time  Subject  Effort  Subject  Stress 
Card  Sort  Proto.  Sort  Proto.  Sort  Proto. 


T 

£ 

s 

1 

£ 

a 

2 

8 

5 

g 

7 

l 

1 

1 

1 

1 

1 

0.0 

1 

1 

0.0 

l 

1 

1 

0.0 

l 

1 

2 

2 

2 

4 

8.7 

4 

2 

11.9 

8 

7 

2 

28.2 

l 

1 

3 

11 

3 

5 

23.4 

13 

3 

26.6 

17 

16 

5 

51.8 

1 

2 

1 

5 

4 

2 

11.3 

7 

10 

29.4 

3 

5 

6 

14.8 

l 

2 

2 

7 

5 

10 

19.9 

10 

11 

41.2 

14 

14 

14 

43.1 

l 

2 

3 

8 

7 

11 

34.6 

22 

12 

55.9 

22 

18 

15 

66.6 

l 

3 

1 

6 

5 

6 

21.7 

16 

19 

58.8 

5 

6 

7 

23.1 

1 

3 

2 

9 

8 

12 

30.4 

19 

20 

70. € 

16 

17 

16 

51.3 

l 

3 

3 

14 

9 

22 

45.1 

25 

21 

85.3 

25 

20 

17 

74.8 

2 

1 

1 

3 

10 

3 

23.7 

2 

4 

7.3 

2 

2 

3 

13.9 

2 

1 

2 

4 

11 

9 

32.4 

5 

5 

19.2 

9 

12 

4 

42.2 

2 

1 

3 

16 

14 

14 

47.1 

14 

6 

33.9 

18 

13 

12 

65.7 

2 

2 

1 

12 

12 

7 

35.0 

8 

13 

36.7 

4 

3 

8 

28.8 

2 

2 

2 

15 

15 

13 

43.7 

11 

14 

48.6 

10 

15 

21 

57.0 

2 

2 

3 

19 

16 

23 

58.4 

23 

15 

63.3 

23 

26 

24 

80.6 

2 

3 

1 

13 

13 

8 

45.5 

17 

22 

66.1 

12 

8 

19 

37.0 

2 

3 

2 

10 

17 

21 

54.1 

20 

23 

78.0 

20 

24 

20 

65.2 

2 

3 

3 

25 

18 

25 

68.8 

26 

24 

92.7 

26 

21 

25 

88.8 

3 

1 

1 

20 

19 

15 

54.9 

3 

7 

14.7 

6 

4 

10 

25.2 

3 

1 

2 

21 

20 

18 

63.6 

6 

8 

26.6 

11 

11 

9 

53.4 

3 

1 

3 

22 

21 

20 

78.3 

15 

9 

41.2 

19 

25 

23 

76.9 

3 

2 

1 

17 

22 

16 

66.1 

9 

16 

44.0 

7 

10 

13 

40.0 

3 

2 

2 

24 

23 

19 

74.8 

12 

17 

55.9 

15 

22 

18 

68.2 

3 

2 

3 

23 

24 

26 

89.5 

24 

18 

70.6 

24 

23 

26 

91.8 

3 

3 

1 

18 

25 

17 

76.6 

18 

25 

73.4 

13 

9 

11 

48.2 

3 

3 

2 

26 

26 

24 

85.3 

21 

26 

85.3 

21 

19 

22 

76.5 

3 

3 

3 

27 

27 

27 

100.0 

27 

27 

100.0 

27 

27 

27 

100.0 
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QVKRATL  ANALYSES  OF  VARIANCE. 


The  FRQSWAT  scores  contributed  by  each  subject  under  each  test  option  are  shown 
in  table  E-2. 

Because  of  the  interval  scale  properties  of  the  transformed  PROSWAT  ratings, 
these  data  were  analyzed  using  standard  parametric  statistical  techniques.  In 
order  to  determine  whether  any  of  the  test  options  produced  significant 
variations  in  perceived  workload,  single  factor,  repeated  measures  analyses  of 
variance  were  performed  on  the  PROSWAT  scores  across  the  eight  experimental 
conditions.  Individual  analyses  were  performed  for  the  altitude  confirmation, 
transfer  of  ocmnunications,  and  AIMS  services. 

Results  of  these  analyses  revealed  that  projected  workload  was  significantly 
affected  by  the  test  options  for  each  of  the  services  (altitude  confirmation, 
F(7,49)=9.26,  pc.0001;  transfer  of  cxxmtunicaticns,  F(7,49)=3.98,  p<.001; 

FMSAW,  F(7,49)=5.12,  p<.0003) .  Based  on  the  significance  of  these  findings, 
individual  post  hoc  analyses  were  performed  using  the  Student's  t  statistic  in 
order  to  assess  the  impact  of  the  individual  display  and  procedural  factors  on 
controller  workload. 

DATA  LINK  TRANSACTION  DISPLAY  LOCATION. 

Mean  PROSWAT  scores  derived  from  ocnparable  procedural  conditions  in  which  the 
Plan  View  Display  (PVD)  list  display  and  the  Computer  Readout  Display  (CRD)  list 
display  were  used  are  presented  in  figure  E-l.  As  shown  in  the  figure,  while  no 
difference  was  obvious  between  the  displays  for  AIMS,  the  PVD  list  received 
lexer  projected  mean  workload  scores  than  the  CRD  list  in  the  altitude 
confirmation  and  transfer  of  ccnuunications  tasks.  However,  t  test  comparisons 
of  these  scores  revealed  no  statistically  significant  differences  in  perceived 
workload  between  the  PVD  and  CRD  displays  either  for  altitude  confirmation 
(t(7)=i.52,  p=.17)  or  for  transfer  of  ccmnunications  (t(7)=.99,  p=.35). 

tttNUAI,  VS,.  jttJTCMAyiC  OCMTRPL. 

Unlike  the  statistically  weak  impact  of  display  location,  strong  effects  on 
FROSWAT  workload  viere  obtained  for  manual  and  automatic  control  options.  Figure 
E-2  presents  the  mean  workload  scores  obtained  for  the  manual  and  automatic 
options  in  each  of  the  tested  services.  The  manual  means  were  calculated  by 
computing  an  average  PROSWAT  score  for  each  subject  across  the  three  test 
conditions  which  required  manual  designation  of  the  relevant  data  in  the  list 
display  and  an  entry  to  release  the  uplink  (manual/pilot  response/PVD, 
manual/pilot  respcnse/CRD,  and  manual/no  pilot  response) .  The  automatic  means 
were  calculated  in  the  same  way  for  the  three  conditions  in  which  the  uplink  was 
achieved  automatically  following  normal  entry  of  the  transfer  of  control  data  to 
the  NAS,  entry  of  an  altitude  amendment,  or  detection  of  an  AIMS  event 
(autcmatic/pilot  response,  automatic/no  pilot  response,  and  automatic/pilot 
response/no  voice) . 

As  shewn  in  figure  E-2  workload  was  higher  in  the  manual  conditions  than  in  the 
automatic  conditions  or  all  three  services.  Statistical  comparisons  confirmed 
the  significance  of  all  three  differences  (altitude  confirmation,  t(7)-3.74, 
pc.Ol;  transfer  of  communications ,  t(7)=2.66,  p<.015;  EM5AW,  t(7)=3.24,  pc.Ol). 
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TABLE  E-2.  FHOSWAT  SCORES  AND  FROTOIYFE  SCALE  VALUES 


Test  Cations 

Altitude  Confirmation 


1 

2 

2 

4 

5 

6 

7 

Subiect 

1 

35.0 

85.3 

66.1 

35.0 

35.0 

11.3 

11.3 

2 

7.3 

7.3 

7.3 

7.3 

7.3 

7.3 

0.0 

3 

66.1 

66.1 

23.7 

0.0 

0.0 

0.0 

0.0 

4 

32.4 

74.8 

74.8 

11.3 

8.7 

0.0 

0.0 

5 

68.2 

68.2 

68.2 

57.0 

57.0 

57.0 

14.8 

6 

40.0 

40.0 

40.0 

0.0 

0.0 

0.0 

0.0 

7 

28.8 

28.8 

37.0 

28.8 

28.8 

0.0 

13.9 

8 

36.7 

36.7 

36.7 

29.4 

41.2 

0.0 

0.0 

Transfer  Of  Ocmnunicatians 

1  23.7  23.7 

35.0 

35.0 

35.0 

23.7 

0.0 

2 

7.3 

7.3 

7.3 

7.3 

7.3 

7.3 

0.0 

3 

66.1 

66.1 

23.7 

0.0 

0.0 

0.0 

0.0 

4 

0.0 

66.1 

66.1 

0.0 

0.0 

0.0 

19.9 

5 

68.2 

68.2 

40.0 

13.9 

68.2 

57.0 

0.0 

6 

25.2 

25.2 

25.2 

13.9 

13.9 

0.0 

0.0 

7 

28.8 

28.8 

28.8 

28.8 

14.8 

13.9 

13.9 

8 

7.3 

7.3 

41.2 

0.0 

0.0 

0.0 

0.0 

EMSAW 

1 

19.9 

19.9 

19.9 

19.9 

19.9 

8.7 

0.0 

2 

7.3 

7.3 

7.3 

7.3 

7.3 

7.3 

0.0 

3 

66.1 

35.0 

0.0 

0.0 

0.0 

0.0 

0.0 

4 

43.7 

74.8 

74.8 

19.9 

19.9 

8.7 

19.9 

5 

25.2 

25.2 

25.2 

13.9 

0.0 

13.9 

0.0 

6 

66.6 

66.6 

66.6 

66.6 

66.6 

0.0 

0.0 

7 

0.0 

0.0 

14.8 

0.0 

0.0 

0.0 

0.0 

8 

41.2 

41.2 

41.2 

41.2 

11.9 

0.0 

0.0 

Test  Option  Key 

1.  Manual/Pilot  Respcnse/Voioe  FVD 

2.  Manual/Pilot  Response/Voice/CRD 

3.  Manual/No  Pilot  Respcnse/Voice 

4.  Autanatic/Pilot  Response/Voioe 

5.  Automatic/No  Pilot  Respcnse/Voice 

6.  Autanatic/Pilot  Response/ no  Voice 

7.  Modifed  Systen/Pilot  Respcnse/No  Voice 
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MEAN  PROSWff  SCORE 


ALTITUDE  TRANSFER  OF  EMS/W 
CONFIRMATION  COMMUNICATIONS 


FIGURE  E-1 .  DATA  LINK  CONTROLLER  WORKLOAD,  TRANSACTION  DISPLAV  LOCATION 
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ALTITUDE  TRANSFER  OF  EMSAV 

CONFIRMATION  COMMUNICATIONS 


FIGURE  E-2.  DATA  LINK  CONTROLLER  WORKLOAD,  MANUAL  VS.  AUTOMATIC  UPLINK 
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VOICE. 


Figure  E-3  presents  the  effect  on  workload  of  the  presence  or  absence  of  voice 
ccmnunicaticns  between  the  controller  and  pilot  which  were  redundant  with  a 
message  delivered  via  Data  Link.  The  FROSWAT  scores  for  the  voice  condition 
were  computed  by  calculating  mean  scores  for  the  two  automatic  conditions  in 
which  redundant  voice  was  included  (with  pilot  response  and  without) .  The  no 
voice  means  were  based  on  the  scores  obtained  in  the  automatic/pilot  response/no 
voice  condition  and  in  the  revised  system  tested  on  Day  2  without  voice.  As 
shown  in  figure  E-3,  mean  workload  scores  were  lower  in  the  no  voice  condition 
than  for  the  voice  condition  for  all  three  services.  Statistical  tests  of  the 
significance  of  these  differences  revealed  a  significant  effect  for  the  altitude 
confirmation  service  (t(7)=3.16,  pc. 05)  and  marginally  significant  effects  for 
transfer  of  ccmnunicaticns  and  EMSAW  (t(7)=l.77,  (>.10  and  t(7)=1.82,  pc. 10, 
respectively) . 

Pimr  RESPONSE. 

A  third  combined  comparison  was  performed  to  assess  the  effect  of  requiring  the 
controller  to  monitor  for  a  downlinked  pilot  confirmation  of  a  received  message. 
In  all  cases,  these  comparisons  were  made  under  voice  conditions  in  which  the 
data  linked  pilot  response  would  be  redundant  with  voice  radio  communications . 
Ihe  mean  workload  ratings  for  each  service  under  both  manual  and  automatic 
conditions  are  presented  below: 


Pilot 

No 

Resoonse 

Resoonse 

Altitude 

Manual 

39.31 

44.22 

confirmation 

Auto 

21.10 

22.25 

Transfer  of 
Communications 

Manual 

28.33 

33.39 

Auto 

12.36 

17.40 

EMSAW 

Manual 

33.75 

31.23 

Auto 

21.10 

15.70 

As  the  illustration  shows,  no  large  or  consistent  differences  in  perceived 
workload  were  obtained  as  a  function  of  the  requirement  for  a  pilot  response 
either  in  the  manual  or  the  automatic  conditions.  Ihe  test  comparisons  between 
all  pilot  response  and  no  response  conditions  detected  no  statistically 
significant  differences  between  the  means  (p>.15  in  all  cases) . 


MODIFIED  , 


OCMPARISONS. 


A  final  group  of  statistical  comparisons  were  performed  to  assess  the 
significance  of  the  reduction  in  workload  produced  by  the  modified  system  tested 
on  Day  2  to  the  conditions  evaluated  on  the  first  day  of  testing.  The  mean 
workload  score  obtained  for  the  modified  system  was  5.00  for  altitude 
confirmation,  4.23  for  transfer  of  communications,  and  2.49  for  EMSAW.  These 
scores  were  significantly  lower  than  the  manual  options  for  all  services 
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(pc.  05) .  In  addition,  projected  workload  on  the  modified  system  was 
significantly  reduced  in  comparison  to  two  of  the  three  automatic  options  for 
altitude  confirmation  (pc. 02) .  Mb  statistically  significant  differences  in 
workload  were  detected  between  the  automatic/no  voice  options  and  the  modified 
systems  for  any  of  the  services. 

Ft^EFiraiK^A3CIPIABILriY  DMA 

The  preference/ £KX«ptability  ratings  produced  by  all  subjects  under  each  test 
option  are  shown  in  table  E-3. 

OVERALL  ANAIYSESOF  VARIANCE. 

Because  of  the  ordinal  characteristics  of  the  ratings  obtained  on  the 
preferencse/aoceptability  scale,  the  results  were  analyzed  using  norparametric 
statistical  tests  of  significance.  Overall  analyses  to  determine  the 
significance  of  variations  in  preference  produced  by  the  test  options  were 
performed  using  the  Friedman  Two-Way  Analysis  of  Variance  by  Ranks.  Unacceptable 
ratings  were  assigned  a  value  of  n8N  for  these  analyses  in  order  to  include 
scores  from  all  subjects  under  each  test  option. 

Significant  variation  in  test  option  preferences  were  detected  for  altitude 
confirmation  (chi  square  (6)  =  26.03,  pc. 001),  and  BCSAW  (chi  square  (6)  =  24.18, 
pc. 001) .  However,  no  significant  differences  in  option  preferences  were  detected 
for  the  transfer  of  conmunications  task  (chi  square  (6)  -  7.0,  p>.4) . 

The  primary  reason  for  the  failure  of  the  transfer  of  conmunications  task 
preference  ratings  to  reach  statistical  significance  w as  the  preponderance  of 
unacceptable  ratings  obtained  under  these  conditions.  While  the  altitude 
confirmation  and  EM5AW  test  options  each  received  only  one  unacceptable  rating 
out  of  56  ratings  per  service,  the  transfer  of  ocmmmicaficns  options  were  rated 
unacceptable  in  11  cases.  These  ratings  were  produced  by  four  different  subjects 
and  were  not  consistently  associated  with  ary  particular  procedural  or  display 
condition. 

Evaluation  of  controller  Garments  indicated  that  these  unacceptable  ratings  were 
attributable  to  the  fact  that  the  original  Day  1  test  options  all  required  the 
receiving  controller  to  uplink  the  new  radio  frequency  to  the  pilot.  Since  this 
is  contrary  to  current  ATC  operational  procedures,  a  number  of  controllers 
assigned  low  preference  or  unacceptable  ratings  to  all  of  the  options, 
disregarding  the  focal  test  parameters.  This  interpretation  is  supported  by 
inspection  of  the  transfer  of  conmunications  preference  ratings  obtained  for  the 
modified  system  on  Day  2  of  testing.  In  this  option,  where  the  frequency  change 
was  under  the  control  of  the  transferring  controller,  no  unacceptable  ratings 
were  assigned  and  preference  ratings  were  significantly  lower  than  those  for  ary 
of  the  other  test  options  (p<.01,  Wiloaxon  test) . 

Based  on  the  general  significance  of  the  overall  analyses,  individual 
norparametric  comparisons  among  test  conditions  were  performed  using  Wilocwon's 
Matched  Fairs  Signed  Ranks  test  in  order  to  evaluate  the  effects  on  controller 
preference  of  the  individual  display  and  procedural  options. 
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TABLE  E-3.  IREFEEm^AlXEFTABIIJT¥  RATINGS 


Test  Options 


Altitude  Confirmation 


1  2 

Subject 

15  5 

2  7  7 

3  7  7 

4  4  7 

5  7  7 

6  17 

7  5  5 

8  5  6 

Transfer  of  Ccnitimications 


2 


2 

6 

5 

7 

5 
4 
3 

6 


4 


2 

5 

3 
2 

4 
4 
3 
3 


5 


1 

5 

5 

U 

5 
3 
3 

6 


6  7 


2 

3 
1 
2 

4 
3 
1 
2 


2 

2 

1 

2 

2 

7 

1 

2 


1 

2 

3 

4 

5 

6 

7 

8 


5  4  3 
7  7  6 
U  7  7 
2  7  7 
u  u  u 


2 

5 
3 
2 

6 


1 

5 

5 
U 

6 


2 

3 
1 
2 

4 


u 

6 

4 


u  u  u  u 
5  5  5  4 
5  5  3  5 


u 

2 

2 


1 

2 

1 

3 

2 

1 

2 

2 


EMSAW 


1 

2 

3 

4 

5 

6 

7 

8 


6 

7 

4 

4 

7 

1 

6 

4 


5 
7 
7 
7 
7 

4 

6 

5 


3 
6 

4 
7 
7 

4 

5 
5 


2 

5 

3 

1 

5 
1 

6 
2 


3 

5 

5 
u 
7 
1 

6 
5 


3 

3 
1 
1 
6 
1 

4 
2 


1 

2 

1 

7 

5 
1 

6 
2 


NOTE:  Completely  unacceptable  ratings  are  indicated  by  "u."  Preference  ratings 
range  from  1  "highly  preferred"  to  7  "acceptable  but  not  preferred." 
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Figure  E-4  shows  the  median  preference  ratings  obtained  for  the  oonparable  test 
conditions  in  which  the  PVD  and  CRD  lists  were  used.  In  general  agreement  with 
the  workload  data,  these  preference  ratings  indicate  that  the  IVD  list  was 
preferred  over  the  CRD  list  for  all  three  tested  services.  Statistical 
comparisons  confirmed  the  significance  of  this  preference  for  both  altitude 
confirmation  (T=0,  pc.Ol)  and  EMSAW  (T=4.5,  pc. 05) .  Put  in  p  level  for  Transfer 
of  control. 

MANUAL  VS.  AUTCMMTC  CONTROL. 

Controller  workload  and  preference  ratings  were  also  closely  correlated  for  the 
ocnpariscn  between  the  manual  and  autocratic  control  options.  Figure  £-5 
presents  the  median  preference  ratings  obtained  for  the  three  test  options 
involving  manual  selection  and  initiation  of  uplinks  and  for  those  which  include 
automatic  uplinks.  All  three  services  ware  more  highly  preferred  when  conducted 
in  the  automatic  modes  than  when  performed  manually  (altitude  confirmation,  T=0, 
p<.01;  transfer  of  communications,  T=0,  (N=7),  P<.02;  EMSAW,  TO,  (N=7) ,  p<.02). 

VOICE. 

Figure  E-6  presents  the  median  preference  ratings  computed  for  the  automatic  mode 
conditions  in  which  redundant  voice  cxrnnunicaticns  were  present  and  for  those  in 
which  Data  link  cxrnnunicaticns  were  the  only  form  of  data  transfer  between  the 
controller  and  the  pilot.  As  shewn  in  the  figure,  controller  preference  ratings 
were  consistently  higher  in  the  no  voice  options.  This  was  confirmed  in 
statistical  comparisons  for  all  three  ATC  services  (altitude  confirmation,  T=3.5, 
p<. 05;  transfer  of  control,  T=0,  pc.Ol;  EMSAW,  T=0,  pc.Ol;  EMSAW,  T=0  (N=7) , 
pc. 02) . 

PILOT  RESPONSE. 

A  exmparison  of  controller  preferences  for  requiring  a  pilot  confirmation 
downlink  is  presented  in  the  following  median  ratings; 

Pilot  No 

Response  Response 


Altitude 

Manual 

5 

5 

Confirmation 

Auto 

3 

4 

Transfer  of 

Manual 

4.5 

5.5 

Ooranunications 

Auto 

3 

5 

EMSAW 

Manual 

5 

5 

Auto 

2.5 

5 

As  shown  above,  the  subject  controllers  appeared  to  have  a  slight  preference  for 
requiring  a  pilot  response  via  Data  Link  in  conditions  where  the  response  would 
be  redundant  with  a  voice  communications .  However,  statistical  comparisons 


T 


» 

► 

} 

\ 
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revealed  no  significant  differences  between  the  conditions  except  for  the 
automatic  version  of  the  IMSAW  service  (T=0,  p<.01)  which  favored  the  pilot 
response. 

Both  the  workload  data  and  the  preference  data  presented  above  for  the  pilot 
response  factor  yielded  equivocal  results.  However,  when  viewed  in  light  of  the 
clearly  superior  preferences  elicited  for  the  no  voice  conditions,  these  data 
suggest  that  the  positive  inpact  of  pilot  confirmation  via  Data  Link  emerges  most 
strongly  when  redundant  voice  radio  calls  are  eliminated. 

MODIFIED  SYSTEM  COMPARISONS. 

The  modified  system  tested  on  Day  2  was  more  highly  preferred  than  any  of  the 
other  options  tested  in  the  mini  study.  The  median  preference  scores  for  all 
three  services  in  this  version  was  2.0.  In  comparison,  median  preference  scores 
for  the  manual  options  ranged  from  4.5  to  7.0,  and  for  the  automatic  options  from 
2.5  to  5.0.  The  only  median  preference  rating  which  equaled  those  obtained  for 
the  modified  system  was  that  elicited  under  the  automatic/no  voice  condition  for 
altitude  confirmation. 


FREFERElKE/AOCEFTMIlurrY  OCWMQnS 

Following  each  rating  on  the  preference/aooeptability  scale,  the  controller 
subjects  were  asked  to  write  brief  comments  explaining  the  rationale  underlying 
their  ratings.  These  contents  are  summarized  below  for  each  test  optical. 
Substantially  similar  oomnents  obtained  from  different  controller  subjects  were 
classified  as  a  single  comment.  All  cases  are  annotated  to  show  the  number  of 
controllers  contributing  the  comment. 


OPTION  1  -  MANUAL  OONIROL/PILOT  RESPONSE  F 


DISPLAY. 


Five  subjects  indicated  that  the  data  entry  requirements  of  this  option  were 
excessive. 


TWo  controllers  noted  that  the  procedure  used  in  the  transfer  of  ocmmunicaticxis 
service  was  inappropriate.  All  transfer  of  communication  tasks  are  the 
responsibility  of  the  transferring  controller.  Thus,  the  receiving  controller 
should  not  initiate  the  uplink  of  the  frequency  change. 

Two  subjects  felt  that  the  list  display  would  be  difficult  to  interpret  when 
several  Data  Link  services  were  displayed  simultaneously . 

One  controller  indicated  that  a  list  type  display  would  distract  the  controller's 
attention  from  his  observation  of  the  central  radar  track  data. 


One  controller  was  concerned  about  TIMEOUT  and  UNABLE  responses.  He  felt  that 
these  were  not  valid  pilot  response  options  to  a  positive  control  uplink. 

One  controller  noted  that  this  option  would  permit  inadvertent  deletion  of  a 
status  line  from  the  list  before  the  pilot  response  was  received. 
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All  eight  subjects  indicated  the  the  PVD  display  was  superior  to  the  CRD  option 
presented  in  this  condition.  The  reasons  given  far  this  preference  were  that 
observing  the  CRD  would  distract  the  controller's  attention  from  the  primary  PVD 
display  (four  subjects) ,  and  that  use  of  the  CRD  would  make  it  unavailable  or  too 
congested  for  display  of  beacon  codes  (two  subjects) . 

No  additional  ccmnents  regarding  the  manual/pilcrt  response  option  were  elicited 
during  this  test  condition. 

Because  of  the  unanimous  agreement  among  subjects  regarding  the  display  option, 
all  succeeding  testing  was  conducted  using  the  PVD  for  display  of  the  Date  Link 
transaction  list. 


y  g  <«  v  m  U ,  ^  s  v*J  v »  m  ;■ 


One  controller  indicated  that  data  entries  appeared  to  be  reduced  under  this 
option  in  ccnparison  to  Option  2.  However,  two  subjects  noted  that  the  data 
entries  were  still  excessive. 

One  controller  felt  that  this  option  was  an  improvement  over  the  "pilot  response 
required"  options  because  it  eliminated  the  need  to  monitor  for  a  WILCD  response. 
However,  two  controllers  indicated  a  concern  over  a  procedure  which  did  not  have 
a  mandatory  requirement  for  pilot  acknowledgement. 


v  v  <•  J  i  v*j^v8  wm  vWi*.  fcg  =>i  v  ■‘•Jr  *  >», 


Six  controllers  explicitly  indicated  that  the  automatic  mode  was  better  than  the 
manual  inodes  tested  in  the  previous  conditions.  No  subjects  rejected  the 
automatic  mode.  However,  two  subjects  felt  that  it  could  be  a  safety  hazard 
under  some  conditions  and  expressed  a  desire  for  a  one-key  message  release  input 
for  uplink  of  an  automatically  prepared  message. 

Reasons  given  for  preference  of  the  automatic  mode  were  the  reduction  in  data 
entry  requirements  and  the  increased  speed  with  which  traffic  would  be  worked. 

Continued  concern  was  also  expressed  over  the  assignment  of  controller 
responsibilities  in  the  transfer  of  cxmmunications  procedure  (one  subject) . 

One  subject  indicated  that  the  message  transaction  status  information  should  be 
displayed  in  the  data  block  on  the  PVD. 
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Equivocal  comments  were  elicited  regarding  this  second  test  of  a  no  pilot 
response  mode.  Of  the  four  subjects  Who  provided  comments,  two  indicated  that 
they  would  accept  this  mode  and  two  argued  that  the  lack  of  acknowledgement  would 
create  confusion  and  anxiety  about  the  agreement  between  data  transmitted  and  the 
pilot's  awareness  of  the  transmission.  The  absence  of  a  strong  opinion  on  this 
question  was  probably  due  to  the  fact  that  Options  1  through  5  were  redundant 
with  voice  radio  oomninicaticns  and  verbal  pilot  acknowledgement. 

A  second  subject  indicated  a  preference  far  displaying  Data  Link  transaction 
data  in  the  aircraft  data  block  (see  Option  4) . 
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A  Wrap-Up  Questionnaire  was  given  to  the  Dallas/Port  Worth  controllers  during  the 
firal  debriefing  on  Day  2  of  testing.  A  copy  of  the  questionnaire  is  contained 
in  appendix  C.  This  appendix  documents  the  statistical  treatment  and  results, 
amputations  were  done  using  a  spreadsheet  on  an  IEM  PC  XT. 

The  questionnaire  was  comprised  mainly  of  7-level  rating  scales  and  free 
narrative  eminent  questions.  The  numerical  values  and  verbal  labels  attached  to 
the  7-level  rating  scales  questions  were: 

7  *  Very  Good, 

6  a  Good, 

5  *  Slightly  Good, 

|  4  *  Fair  (center  scale) , 

*  3  *  Slightly  Fbor, 

►  2  *=  Boar,  and 

1  *  Very  Boor. 

>  These  values  were  used  for  the  amputation  of  the  rating  scale  statistical 
results.  Narrative  oonments  for  all  questions  were  acnpiled  and  are  attached 

p  herein.  Also,  a  frequency  count  of  controllers  making  similar  written  oonments 

»  is  attached. 


Table  F-l  shows  the  resulting  descriptive  and  inferential  statistics  for  the  24 
items  rated  using  the  7-level  rating  scale.  Items  1,  5a-c,  6a -e,  8a-b,  and  9a-l 
in  this  table  are  arranged  in  the  same  order  as  they  appeared  in  the 
questionnaire.  Means  and  variation  about  the  means  were  ccnputed  for  each  of  the 
items.  A  grand  mean  across  subjects  and  items  was  oenputed  for  the  entire 
questionnaire.  Student's  t  scores  were  ccnputed  for  the  deviation  of  the  means 
from  center  scale  (4)  and  from  the  grand  mean.  Table  F-2  shows  the  same  results 
as  table  E-l,  but  with  the  items  presented  in  order  of  the  magnitude  of  the 
t  score  oenputed  relative  to  the  grand  mean.  A  95-percent  confidence  interval 
about  each  item  mean  was  also  oenputed.  Notes  at  the  bottom  of  the  tables  give  a 
brief  explanation  of  the  meaning  of  the  table  headings. 

The  t  score  relative  to  center  scale  indicates  whether  that  mean  rating  is 
significantly  above  or  below  fair.  The  t  score  relative  to  the  grand  mean 
indicates  whether  the  mean  rating  is  significantly  above  or  below  the  mean  of  all 
scores,  which  was  oenputed  to  be  5.77  (between  slightly  good  and  good) .  The 
grand  mean  thus  falls  approximately  in  the  middle  of  the  group  of  item  means. 
Ranking  of  the  t  scares  relative  to  each  other,  such  as  in  table  F-2,  makes 
ocupariscn  easier.  These  ranks  are  given  in  the  results  below. 

The  following  results,  using  a  95-percent  probability  criterion  (p=.05)  for 
significance,  were  obtained.  The  grand  mean  was  significantly  higher  than  center 
scale,  indicating  that  the  distribution  of  all  judgements  was  significantly 
favorable  to  Data  Link  (i.e. ,  to  the  good  side  of  center  scale) .  Of  the  24  items 
rated,  18  were  rated  good  (significantly  higher  than  fair),  6  were  rated  fair 
(did  not  differ  significantly  from  fair) ,  and  none  were  rated  poor  (significantly 
lower  than  fair) .  Considering  the  nature  of  the  questionnaire  items,  this  shows 
an  overwhelming  acceptance  of  the  Data  Link  ocnoept. 
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Statistical  Results  Presented  in  Questionnaire  Order 
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Relating  the  item  means  to  the  grand  mean  in  table  F-2  finds  seven  items  rated 
significantly  higher  than  the  grand  mean,  with  one  so  close  to  the  cutoff  that 
it's  included.  These  eight  items  are  ranked  according  to  the  magnitude  of 
the  t  score  relative  to  the  grand  mean  (tgm)  score  (first  item  is  hipest  rated) . 


They  are: 

Rank 

No. 

Item  (Paraphrased) 

1 

8b 

Projected  performance  using  best  transfer  of  cxsnratmication 
method. 

2 

8a 

Projected  performance  using  best  altitude  confirmation 
method. 

3 

91 

Projected  overall  controller  workload,  4 -6a.  Automatic 
mode  for  field  use,  5-9a.  Projected  system  capacity,  6-6d. 

PVD  display  for  field  use. 

7 

9f 

Projected  pilot-controller  ocnnimications. 

8 

9k 

Projected  overall  safety. 

One  of  the 

items 

is  rated  significantly  below  the  grand  mean  and  one  is  so  close 

to  cutoff  that  it  is  included  below  (the  last  is  the  worst) : 

Rank 

Item  fParachrased) 

23 

6b 

Manual  mode  for  field  use. 

24 

6c 

RCRD  display  for  field  use. 

The  use  of  a  ranking  based  on  the  tgm  makes  possible  determination  of  which  items 
are  so  much  above  or  so  much  below  the  grand  mean  as  to  be  notable.  Above  are 
shown  the  10  notable  items  out  of  the  total  of  24  items  analyzed. 


QUESTION  BY  QUESTION  RESULTS. 

Question  1  asked  for  a  rating  of  the  simulation  realism.  The  resultant  mean 
rating  is  significantly  better  than  fair.  Thus,  realism  is  judged  good.  It  is 
not  significantly  different  from  the  grand  mean,  with  a  rank  *  14. 

Question  2  shows  suggested  improvements  for  reed  ism.  Five  suggestions  are  made. 
These  are  in  the  narrative  comments  section  attached. 

Question  3  asks  for  documentation  of  system  malfunctions.  Three  are  mentioned. 
These  are  in  the  narrative  comments  section  attached. 

Question  4  asks  for  training  suggestions.  Three  are  listed.  These  are  found  in 
the  narrative  comments  section. 

Question  5  asked  for  an  ervaluaticn  of  SWAT.  All  three  items  on  SWAT  were  rated 
significantly  higher  than  center  scale,  meaning  they  were  judged  good.  None  was 
significantly  different  from  the  grand  mean.  The  highest  SWAT  aspect  was 
independence  of  SWAT  dimensions  (rank  =  13) ,  and  the  lowest  was  effectiveness  as 
ATC  workload  measure  (rank  =  20).  It  should  be  noted  that  verticle  lines  were 
omitted  from  the  scale  inadvertently,  leading  to  several  misinterpretations  and 
entry  omissions. 

Question  €  asked  for  ratings  of  the  various  configurations  in  which  Data  Link 
could  be  operated.  Two  were  highly  rated  for  field  use:  automatic  mode 
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rank  =  4)  and  FVD  display  (rank  =  6) .  Die  two  lowest  rated  for  field  use  were: 
manual  mode  (rank  =  23)  and  RC3®  display  (rank  =  24) . 

Question  7  required  designing  the  optimum  features  for  each  service.  The 
breakdown  is  given  below.  The  asterisk  (*)  shows  significance  at  the  95  percent 
level. 

control  Pilot 


Mode 

Voice 

Voice 

Display 

Martial  AUtO 

XSS  HS 

Yes  & 

FVC  CRD 

Altitude  Confirmation 

1  8* 

1  9* 

2  8 

10*  0 

Transfer  of  Communication 

1-1-  7* 

1  9* 

1  9* 

10*  0 

EMSAW 

1  5 

5  4 

5  4 

10*  0 

Question  8  rated  the  three  services  envisioning  usage  of  the  optimum  Data  Link 
configuration.  Of  the  three  services,  transfer  of  ccnnunication  and  altitude 
ocnfirmation  were  rated  so  good  they  were  the  first  and  second  most  highly  rated 
of  all  items  rated.  The  EKSAW  rating  fell  below  the  grand  mean  (rank  -  17  from 
the  top),  but  not  significantly  so.  Nevertheless,  this  indicates  a  relatively 
low  opinion  of  the  EMSAW  service  compared  to  the  other  two. 

Question  ^  asked  for  ratings  of  various  aspects  of  the  ARC  operation  if  optimized 
Data  Link  were  used  in  the  field  environment.  Results  indicated  that  all 
projected  Data  Link  effects,  except  for  weather  and  conflicts,  were  significantly 
good.  This  includes  controller  workload  (rank  =  3) ,  system  capacity  (rank  =  5) , 
pilot-controller  communications  (rank  =  7) ,  and  overall  safety  (rank  =  8) . 

Question  10  inquired  about  locating  gaps  in  the  Data  Link  system.  Narrative 
responses  indicated  no  gaps  that  voice  couldn't  fill. 

Question  11  what  was  liked  best  about  Data  Link.  Narrative  answers  found 

in  a  latter  section  of  this  report  indicate  that  many  features  were  liked.  Table 
03  (appendix  C)  gives  the  frequency  of  controller  response  to  popular  comments. 

Question  12  asked  what  was  liked  best  about  Data  Link,  me  answers  are  in  the 
narrative  comments  section. 

Question  13  asked  for  projected  future  uses  of  Data  Link.  mere  are  marry 
comments  listed  in  the  narrative  section.  The  projected  uses  seem  unlimited. 

SUMARY 


POSITIVE  FINDINGS. 

The  Dallas/Port  Worth  controllers  reported  that  the  Data  Link  mini  study  had  good 
realism,  training  was  adequate,  and  malfunctions  minimal.  They  judged  that  a 
Data  Link  system  using  the  automatic  mode  and  FVD  list  display  would  work  well  in 
providing  transfer  of  ooranunication  and  altitude  confirmation  for  en  route 
control.  Without  the  need  for  controller  or  pilot  voice  for  these  function,  they 
judged  that  Data  Link  would  reduce  voice  congestion.  It  was  considered  that 
projected  use  of  such  a  Data  Link  system  would  have  good  effects  on  controller 
workload,  pilot-controller  ocmnunications,  and  overall  ATC  safety  and  efficiency. 
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negative  findings. 

The  Dallas  Fort  Worth  (D/FW)  controllers  rated  use  of  manual  mode  and  the  RCRD 
display  no  worse  than  fair;  but  they  were  the  two  lowest  rated  ocnfiguraticns  of 
all  the  items  in  the  questionnaire.  They  rated  the  DKAW  function  such  less 
favorably  than  transfer  of  cntwimication  and  altitude  confirmation.  However, 
problems  with  EM3AW  appear  to  be  carried  over  from  its  NAS  implementation  in  the 
flat  lands  of  Dallas/Fort  Worth.  This  may  have  affected  its  specific  Data  Link 
implementation  as  used  in  the  mini  study.  EMSAW  needs  further  review  regarding 
manual  versus  automatic  implementation  and  the  necessity  of  oontroller/pilot 
voice. 


NARRATIVE  RESPONSES. 


The  toted,  set  of  narrative  responses  is  listed  below  for  the  13  questions  of  the 
Wrap-Up  Questionnaire.  Arbitrary  numbers  from  1  to  10  were  assigned  to  the  10 
controller  subjects  and  are  listed  on  the  left  margin  beside  their  responses. 
Table  F-3  shows  a  summary. 

Question  1.  (No  Narrative  Responses) 

Question  2.  How  can  we  enhance  realism? 

2.  Not  without  speeding  up  the  process. 

4.  Use  realistic  altitudes  (FL300?) ,  better  trained  pilots. 

6.  Realism  is  good.  It  would  be  difficult  to  improve. 

7.  Increase  the  number  of  actions. 

9.  Design  a  more  realistic  map  and  have  the  aircraft  actually  cross  the 
boundaries. 

10.  It  looked  pretty  real  to  me. 

Question  3.  Please  document  any  system  malfunctions  that  if  worked  as  designed 
would  have  helped  you  make  a  better  evaluation. 

2.  In  seme  areas  we  received  taro  indications,  data  block  and  list.  Only  one 
indication  is  needed. 

3.  None. 

4.  None. 

6.  A  small  problem  surfaced  whereas  when  a  TC  was  accepted,  data  would  appear 
in  the  list  as  HELD.  This  was  later  resolved. 

7.  Initial  services  had  too  many  keypunches. 

10.  None. 
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Question  4.  Looking  back  at  training,  ary  new  ideas  as  to  what  training  would 
have  added  testing? 

2.  Do  away  with  script. 

3.  Initial  briefing  and  notebook  handout  were  helpful  training  aids.  The 
ability  to  use  en  route  lab  was  extremely  helpful. 

4.  No. 

5.  Train  remotes  or  pilots  longer  on  the  techniques  of  A3C,  where  a  script  is 
not  needed  to  follow  along.  More  action-reaction  type  training.  More 
realistic. 

6.  Training  was  good. 

7.  No. 

9.  Excellent  training  and  back  group  information  were  provided. 

10.  None. 

Question  5.  Ccranerrts  on  SWAT. 

3.  Interesting  -  but  not  fully  understood. 

4.  Good  tool. 

6.  It  is  difficult  to  evaluate  SWAT  because  I  am  not  familiar  with  the  rating 
process,  however,  I  readily  understand  how  I  was  supposed  to  provide 
information  and  was  able  to  determine  or  define  the  different  categories  of 
workload.  It  seems  very  effective. 

9.  Different  controllers  -  different  workload. 

10.  Good. 

Question  6.  Please  rate  these  Data  Link  aspects  regarding  possibility  of 
utilization  in  the  field.  Ocnments. 

1.  The  display  mode  will,  over  time,  require  both  RCRD  and  FVD,  based  on  type 
and  volume  service. 

3.  Strong  preference  for  auto  mode.  Manual  mode  keystroke  entries  are 

excessive  and  time  consuming. 

4.  Message  response  times  need  to  be  increased  (decreased?)  for  control 
functions.  For  ncncontrol  functions,  time  is  OK. 

7.  This  may  need  a  combination  of  PVD  and  CRD  in  final  form. 

8.  Need  visual  indication  in  the  data  block,  with  the  FVD  list  available 
also. 
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Question  7.  Please  select  the  opt  imam  methods  for  the  three  services.  Comments. 

3.  Both  ocxTtrol/pilot  voice  will  be  required  until  we  have  a  proven  system. 
Even  long-term  voice  mode  will  be  required  in  certain  situations.  I  don't 
believe  d/1  can  totally  replace  voice. 

4.  Voice  ability  still  needs  to  be  there,  available  for 
clarification/ negotiation  on  transfer  of  control  and  altitude  confirm. 

7.  EMSAW  does  not  lend  itself  to  this  program. 

8.  As  before  -  visual  indication  somehow  in  the  aircraft's  data  block  to 
avoid  extensive  lists  that  may  make  it  difficult  to  locate  in  a  timely 
nanner  certain  aircraft. 

9.  Voice  control  must  be  available  for  emergency  situation. 

10.  under  present  configuration,  manual  altitudes  would  be  required  unless 
options  ware  available  in  which  the  controller  controlled  who  the  message 
went  to. 

Question  8.  Please  rate  how  well  each  service  would  perform  at  your  position  if 

optimally  configured.  Ocranents. 

1.  MSFN  is  a  questionable  program. 

3.  Still  need  seme  "fine-tuning"  but  principles  are  sound. 

9.  Response  time  faster. 

10.  As  long  as  control  is  had  on  where  the  altitude  is  sent.  Alt  Change  - 
None  Key  P  (Pilot  and  NAS) 

None  Key  U  (Uplink  info  that  is  entered  under  none  key  only) 

None  Key  (NAS  only) . 

Question  9.  Using  the  optimum  services,  what  would  be  the  projected  effect  of 

Data  Link  at  your  position  on  the  following.  Cements. 

1.  The  system  must  reduce  aom  and  increase  the  capacity. 

4.  Those  items  marked  good  (instead  of  very  good)  were  marked  that  way 
because  of  slow  speed.  There  are  instances  where  voice  is  faster.  An 
altitude  on  turn  is  needed  quickly  for  safety. 

7.  Flight  strip  marking/handling  does  not  appear  to  be  affected  by  Data  Link 
under  today's  conditions.  This  also  applies  to  status  board  info. 

8.  There  sue  certain  areas,  like  strips,  etc.,  where  little  inpact  would 
happen  from  current  procedures.  There  are  areas  like  frequency  changes, 
altitudes,  etc.,  where  the  Mode  S  would  be  extremely  useful,  efficient, 
and  timely. 

10.  I  believe  that  workload  will  not  be  impacted  if  the  system  is  implemented 
with  minimum  extra  entries  as  discussed  previously. 


) 
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Question  10.  Using  Data  Link  should  leave  no  "gaps"  in  the  system.  Did  you  see 
any  plaaes  where  gaps  in  positive  control  could  occur?  Also,  give  any  ideas  as 
hew  to  prevent  them. 

1.  No  gaps  is  the  primary  concern,  however,  just  as  important  is  not 
increasing  workload  or  add  layers  of  duplicate  oenmands. 

2.  Data  Link  is  tied  into  information  swap  by  radar.  This  10-secorri  sweep 
makes  Data  Link  too  slew  for  control  instructions.  Control  instruction 
are  given  in  priority  order  and  need  to  be  carried  out  in  that  order.  It 
can,  however,  be  used  as  an  aid  in  nen-t ime-cr i tical  clearances. 

3.  The  matter  of  pilot  confirmation  method  still  needs  to  be  fine-tuned. 

4.  Yes  -  when  a  pilot  has  a  no  reply  -  voice  is  then  needed  to  find  out  why. 

5.  Slow  response  to  and  from  pilot. 

6.  Yes,  during  adverse  weather  conditions  voice  oocnunications  would  become 
necessary,  thus,  there  is  no  benefit  derived  from  Data  Link  in  this  area. 
However,  Data  Link  utilized  in  the  other  areas  during  these  periods  would 
significantly  enhance  (reduce?)  controller  workload. 

7.  None  are  apparent  at  this  time. 

8.  No  gaps,  just  a  "weaning"  period  for  test  purposes  to  get 
oontrollers/pilots  used  to  having  oertain  procedures  done  visually  now, 
rather  than  verbally. 

9.  If  the  oontroller/pilot  voice  link  is  always  maintained,  the  gape  could  be 
filled  the  "old  way"  with  direct  ocmnunicaticn.  I  feel  that  gaps  would  be 
the  exception  rather  than  the  rule. 

10.  No. 


Question  11.  What  about  Data  Link  do  you  like  best  and  why? 

1.  The  ability  to  reduce  the  voice  conn  and  increase  system  capacity  while 
reducing  workload. 

2.  Ability  to  transfer  data  that  is  repeated  several  times  by  the  controller. 

3.  The  ability  to  reduce  frequency  congestion.  Provides  a  backup/altemate 
method  of  ccnnunicaticn  with  pilot. 

4.  Automatic  function,  prevents  frequency  congestion,  hard  copy  confirmation 
of  control  action. 

5.  The  possibly  of  the  unlimited  uses  that  can  be  added  to  the  Data  Link. 
Relief  of  frequency  congestion. 

6.  Speed  and  reduction  of  controller  workload  (during  the  automatic  mode) . 
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4.  Weather/S igmets .  Turns,  Speed  Control.  Altimeters.  Data  Link  A/C  speed 
and  heading  to  controllers  PVD.  This  would  prevent  controller  from  asking 
pilot  for  speed  and  beading. 

5.  A  constant  readout  of  the  cockpit  data,  ground  speed,  or  mach  speed, 
heading. 

6.  All  aspects  of  ATC,  primarily  to  eliminate  voioe  ocamunicaticn,  thus 
reducing  workload  (controller  and  pilot)  and  frequency  congestion. 

7.  Every  radio  transmission  that  can  be  eliminated  by  data  link  the  better. 

8.  Headings,  speeds,  etc.  Would  require  lots  of  input  on  specific  headings, 
specific  degree  turns,  mach  speeds,  indicated  speeds,  ground  speeds,  etc. 
and  how  do  you  indicate  all  this  in  current  data  block  information. 

9.  Coded  routes  and  altitude  assignments.  Automatic  frequency  assignment 
tied  to  certain  sectors.  Inhibit  message  capability. 

10.  Provide  controller  with  aircraft's  heading,  indicated  airspeed,  mach  speed 
(these  items  an  request  by  manual  entry  at  the  control  position) .  Issue 
radar  vectors,  revised  route,  clearance  to  deviate,  holding  instructions, 
and  approach  clearances. 


( 
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TABLE  F-3. 


COUNT  OF  WRITTEN  OONTIOLLJSR  RESPONSES 
TO  WRAP-UP  QUESTIONNAIRE 


This  section  shows  the  frequency  of  controller  comments  for  Wrap-Up  questions 
6  -  13.  It  shews  the  lumber  of  controllers  that  made  similar  comments  over  the 
course  of  the  questionnaire.  In  the  left  margin  is  the  number  of  controllers 
making  a  particular  comment. 

9  Using  Data  Link  should  reduce  frequency  congestion. 

6  Possible  future  service  -  up/downlink  indicated  airspeed. 

5  Possible  future  service  -  up/downlink  mach  number. 

5  Possible  future  service  -  downlink  heading. 

5  Speed  of  Data  Link  response  is  sometimes  too  slow. 

4  Voice  is  a  necessary  backup. 

3  Possible  future  service  -  waather  info  (Sigmets,  turbulence,  ATIS) . 

3  Data  Link  should  reduce  workload. 

3  EMSAW  is  not  optimized. 

3  Possible  future  service  -  turns  (vectors) . 

2  Possible  future  service  -  field  10  (route)  amendments. 

2  Possible  future  service  -  downlink  groundspeed. 

2  Possible  future  service  -  coded  altitude  assignments. 

2  Possible  future  service  -  automatic  frequency  assignments. 

2  Use  data  block  not  list  for  Data  Link  display. 

2  Data  link  can  increase  capacity. 

2  Data  Link  provides  backup  oenmunications  (failsafe) . 

2  Many  foreseen  data  link  uses. 

2  There  is  little  impact  on  flight  strip  handling. 

2  Data  Link  display  will  need  to  use  both  PVD  and  CRD. 

2  Speed  is  OK  for  noncontrol  but  not  for  control  functions. 

1  Possible  future  service  -  collision  alert. 

1  Possible  future  service  -  KSAW. 

1  Possible  future  service  -  general  information 
1  Possible  future  service  -  altimeter. 

1  Possible  future  service  -  all  aspects  of  ATC. 

1  Possible  future  service  -  coded  routes. 

1  Possible  future  service  -  inhibit  message  capability. 

1  Possible  future  service  -  clearance  to  deviate. 

1  Possible  future  service  -  holding  instructions. 

1  Possible  future  service  -  approach  clearances. 

1  Data  Link  increases  controller  speed. 

1  Pilot  confirmation  method  needs  to  be  fine  tuned. 


Following  completion  of  the  Wrap-Up  Questionnaire  during  the  Day  2  debriefing 
session,  the  eight  subject  controllers  and  the  two  observer  controllers  were 
asked  to  write  a  narrative  description  of  their  preferred  design  for  the  three 
services  under  evaluation.  lhe  purpose  of  this  exercise  was  to  obtain 
unstructured,  individual  cxxnnentaries  from  the  controllers  that  may  not  have 
been  elicited  during  the  group  discussions  that  took  place  during  the  Day  1 
debriefing  sessions. 

lhe  responses  that  were  collected  during  this  session  ranged  from  specific  design 
suggestions  to  general  views  on  the  utility  of  Data  Link.  In  order  to  summarize 
these  data,  sentences  and  paragraphs  from  the  individual  responses  were 
categorized  by  topic  area  and  paraphrased  to  form  brief  opinion  statements.  Each 
of  the  statements  listed  under  the  topics  below  represents  an  opinion  extracted 
from  a  single  controller's  narrative. 

1.  General  opinions  About  Data  Link. 

I  support  the  introduction  of  Data  Link  in  small,  fail-safe  elements,  lhe 
three  services  tested  here  are  a  good  start. 

I  like  the  Data  Link  program.  It  will  increase  the  number  of  aircraft  that 
can  be  efficiently  controlled. 

I  am  concerned  about  Data  Link  assuming  primary  ATC  functions  of  controlling 
aircraft  heading,  speed,  and  altitude.  These  must  be  done  in  a  timely  fashion 
and  without  farcing  the  controller  to  monitor  displays  for  delayed  pilot 
response.  Data  Link  is  good,  but  functions  should  concentrate  on  general 
information  to  pilots  and  on  providing  cockpit  information  to  controllers. 

Data  link  nust  reduce  workload. 

Data  Link  will  improve  the  ATC  system.  Reduction  of  voice  radio  is  the  only 
way  to  handle  increased  traffic  volume. 

Overall,  Data  link  appears  to  be  a  tremendous  enhancement  to  the  system  we 
have  today.  Its  future  uses  seem  limitless. 

The  project  is  very  good  and  holds  much  potential. 

This  will  be  our  method  of  operation  in  the  near  future.  It  will  be  safer 
and  we  will  be  able  to  do  our  job  better. 

2.  Data  Link  Displays. 

The  PVD  should  present  the  Data  Link  display,  this  is  where  the  controller 
keeps  his  attention  focused. 

WD  is  best. 

Any  Data  Link  display  belongs  on  the  PVD  with  location  selectable. 

List  belongs  on  the  IVD  for  easy  access  by  trackball. 

Use  a  IVD  display. 
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Transaction  list  lines  should  be  alphabetically  labeled  for  addressing  by 
D-ccntroller  from  his  keyboard. 

3.  Use  of  the  Data  Block. 

The  controllers  unanimously  preferred  the  FVD  over  the  CRD  as  a  location  for  the 
Data  Link  transaction  list.  However,  a  number  of  comments  were  directed  toward  a 
preference  for  providing  information  on  the  current  status  of  any  transaction  in 
the  data  block  rather  than  in  a  list.  Ocnments  and  suggestions  related  to  this 
concept  are  listed  below: 

The  list  is  hard  to  scan  and  interpret  when  lengthy.  In  addition,  scrolling 
of  a  long  list  could  be  problematic.  Put  primary  Data  Link  information  in  the 
data  block  where  the  controller  is  focused.  Suggests  a  single  character  denoting 
send  (s) ,  WILOO  (w) ,  etc. ,  alternating  with  altitude  change  arrows  in  data  block. 

TVro  displays  are  needed.  A  list  on  the  PVD  to  act  as  a  menu  for  Data  Link 
functions  available,  and  a  data  block  display  for  visual  tracking  of  the  Data 
Link  transaction.  A  PVD  or  CRD  list  could  be  used  for  other  noncritical 
downlinks  from  aircraft. 

A  data  block  display  would  be  best  with  single  characters  for  pilot 
acknowledgement,  etc.  Color  coding  could  also  be  used  when  it  becomes  available. 

Put  as  much  information  in  the  data  block  as  possible.  The  data  block  should 
show  that  the  aircraft  is  on  frequency  and  ready  to  receive  Data  Link  messages. 

The  ultimate  would  be  a  data  block  display  timesharing  with  present 
information.  Data  block  should  show  pilot  responses  to  uplinks. 

Menu  function  mic^it  be  useful  as  a  PVD  list. 

4.  Controller  Data  Entry. 

Minimize  keyboard  entries. 

Automatic  deletion  of  list  lines  when  WILOO  received  is  great.  It  reduces 
extra  keyboard  inputs. 

Keep  key  entries  to  a  minimum. 

5.  Automatic  and  Manual  Modes. 

The  controllers  expressed  a  general  preference  for  automatic  operations  in  their 
narratives.  However,  in  most  cases  they  preferred  a  design  in  which  it  was 
possible  to  use  a  single  key  input  either  to  inhibit/delay  an  automatic  uplink  or 
to  control  the  routing  of  the  ocmputer  input  to  aircraft  and  the  NAS  by  seme 
other  means.  The  following  comments  were  relevant  to  this  issue: 

Automatic  mode  is  more  preferable  except  in  cases  where  the  controller  must 
hold  off  transfer  of  communications  after  the  hand-off.  Need  an  optional  inhibit 
input  preceding  message  to  achieve  this.  Inhibit  should  be  possible  by  sector 
and  aircraft. 
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Automatic  mode  preferred  with  inhibit. 

Want  automatic  with  inhibit  capability. 

Must  have  "inhibit  auto  uplink  function". 

Automatic  uplink  on  all  services  with  inhibit  for  transfer  of  ccnnunications. 
Services  can  be  automatically  initiated. 

6.  Voice  with  Data  Link. 

Primary  benefit  of  Data  Link  will  be  elimination  of  voice. 

Voice  should  be  available  to  resolve  questions. 

Voice  not  needed  in  most  cases. 

Data  Link  can  replace  voice,  but  voice  must  always  be  available  to  back-up 
Data  Link. 

Do  not  duplicate  commands.  Data  Link  should  not  be  redundant  with  voice. 

7.  Altitude  Confirmation  -  Specific. 

This  service  will  require  more  care  than  the  others,  it  must  be  flexible  and 
100%  reliable. 

Altitude  confirmation  display  should  use  single  character  codes  in  the  second 
line  of  the  data  block  to  indicate  sent,  received,  WIICO,  etc. 

It  is  essential  that  the  controller  has  the  latitude  to  determine  routing  of 
messages  when  entered.  A  single  character  prefix  to  entry  would  send  altitude  to 
NAS,  or  NAS  and  pilot,  or  pilot  only.  This  would  permit  assignment  of  temporary 
altitudes. 

The  system  must  be  failsafe,  no  false  or  erroneous  uplinks. 

Altitude  assignments  should  be  adaptable  by  sector  to  permit  standard, 
automatic  altitudes. 

Altitude  assigrnent/oonfirmation  should  be  a  first  step  in  Data  Link.  It 
should  be  automatic  with  an  inhibit  function  for  cases  where  the  controller  wants 
only  a  data  block  update.  Voice  should  be  available  to  deal  with  unables  or 
questions. 

Use  FVD  display.  Delete  status  line  after  receipt  of  pilot  response. 
Automatic  mode  acceptable  with  voice  backup.  Don't  use  Data  link  for  interim 
altitude  assignment. 

8.  Transfer  of  Oconunications  -  Specific. 

This  service  is  best  for  early  implementation.  Gould  be  very  good  in 
automatic  mode  with  no  voice. 


6-3 


Transfer  of  ocnnunications  will  require  the  inhibit  uplink  function. 

Third  line  of  data  block  could  be  used  to  display  transfer  of  ocnnunications 
transaction  status  alternating  with  "H"  symbol  for  hand-off.  Both  transferring 
and  receiving  controllers  should  have  a  display. 

Make  this  automatic  with  inhibit  function.  No  voice  needed. 

Can  be  automatic  with  time  out  on  pilot  response.  Accepting  controller 
should  get  a  message  showing  aircraft  is  on  frequency.  No  initial  pilot  voice 
check-in  needed. 


An  alternative  would  be  to  have  Data  Link  set  up  a  FVD  list  of  aircraft  that 
have  been  handed  off.  Using  a  single  key  entry,  controller  would  transfer 
ocnnunications.  Once  wilcoed,  the  aircraft  would  drop  off  the  list. 

9.  EMSAW  -  Specific. 

Fix  the  reliability  of  EMSAW  and  Data  Link  can  serve  this  function,  if  it  is 
as  fast,  or  faster  than  controller's  response. 

EMSAW  OK  if  refined  and  uplink  message  "informs”  passively  of  a  potential 
problem.  Should  not  be  a  positive  control  emergency  message. 

Controllers  from  mountainous  areas  should  be  consulted. 

See  mountain  area  controllers. 

EMSAW  should  be  an  automatic  uplink. 

Don't  connect  EMSAW  to  Data  Link. 

10.  General  Comments. 

One  controller  offered  alternative  services  for  early  implementation  on  Data 
Link.  These  are  outlined  below: 

Data  Link  should  be  used  to  provide  the  controller  with  cockpit  information. 
Automatic  downlinks  of  airspeed,  heading,  etc.,  should  be  available  and  selected 
by  controller  for  a  time  shared  display  in  the  data  block. 

Other  general  information  such  as  ATIS,  altitude  settings,  SIGMETS,  and 
expected  delays  should  be  automatically  uplinked  to  cut  frequency  time  and  reduce 
controller  workload. 
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